-- Logs begin at Sat 2022-09-24 14:21:23 UTC, end at Sat 2022-09-24 15:19:20 UTC. -- Sep 24 14:51:21.107356 dv-cinder-859194-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 14:51:21.116957 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 14:51:21 2022] *** Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: nodename: dv-cinder-859194-1-iscsi Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: machine: x86_64 Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: clock source: unix Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: pcre jit disabled Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: detected number of CPU cores: 4 Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: current working directory: / Sep 24 14:51:21.118944 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: detected binary path: /usr/bin/uwsgi-core Sep 24 14:51:21.119611 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: your processes number limit is 47680 Sep 24 14:51:21.119611 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: your memory page size is 4096 bytes Sep 24 14:51:21.119611 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: detected max file descriptor number: 2048 Sep 24 14:51:21.119611 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: lock engine: pthread robust mutexes Sep 24 14:51:21.119611 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: thunder lock: enabled Sep 24 14:51:21.119611 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 14:51:21.119611 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 14:51:21.158811 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: Python main interpreter initialized at 0x55afac32f9c0 Sep 24 14:51:21.158811 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: python threads support enabled Sep 24 14:51:21.158811 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: your server socket listen backlog is limited to 100 connections Sep 24 14:51:21.158811 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: your mercy for graceful operations on workers is 90 seconds Sep 24 14:51:21.159111 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 14:51:21.159259 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: *** Operational MODE: preforking *** Sep 24 14:51:21.159482 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: *** uWSGI is running in multiple interpreter mode *** Sep 24 14:51:21.159482 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: spawned uWSGI master process (pid: 105413) Sep 24 14:51:21.159656 dv-cinder-859194-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 14:51:21.163073 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: spawned uWSGI worker 1 (pid: 105414, cores: 1) Sep 24 14:51:21.163073 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: spawned uWSGI worker 2 (pid: 105415, cores: 1) Sep 24 14:51:21.163073 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 14:51:21.818825 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 14:51:21.819427 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 14:51:22.903681 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:51:22.903681 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: from cryptography.utils import int_from_bytes Sep 24 14:51:22.904301 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:51:22.904301 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: from cryptography.utils import int_from_bytes Sep 24 14:51:22.905361 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:51:22.905361 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: from cryptography.utils import int_from_bytes Sep 24 14:51:22.905786 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:51:22.905786 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: from cryptography.utils import int_from_bytes Sep 24 14:51:25.393739 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:51:25.394328 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:51:25.394524 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:51:25.394884 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:51:25.395070 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:51:25.395427 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:51:25.395511 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:51:25.395601 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.395816 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.395915 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:51:25.396133 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.396225 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:51:25.396436 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:51:25.396535 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.396757 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.396848 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.397065 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.397155 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.397381 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.397475 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.397695 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.397789 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.398045 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.398153 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.398303 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.398396 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.398613 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.398704 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.398932 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859194-1-iscsi {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.399030 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.399249 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.399343 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.399550 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.399645 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.399854 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.400029 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.400166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.400258 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859194-1-iscsi {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.400463 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.400548 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.400779 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.400865 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.401077 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.401166 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.401394 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.401568 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.401700 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.402030 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.402161 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.402338 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.402474 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.402648 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.402842 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.402982 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.403154 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.403301 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.403462 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.403598 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.403774 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.403866 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.404110 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.404250 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.404425 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.404595 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.404734 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.404828 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.405044 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.405144 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859194-1-iscsi {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.405354 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.405448 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.405678 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.405807 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.406016 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.406116 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.406410 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859194-1-iscsi {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.406501 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.406723 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.406816 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.407026 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.407129 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.407339 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.407424 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.408280 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.408366 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.408591 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.408675 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.408903 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.408993 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.409220 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.409313 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.409538 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.409635 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.409849 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.409970 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.410176 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.410262 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.410484 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.410588 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.410792 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.410877 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.411107 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.411200 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.411409 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.411504 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.411711 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.411803 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.411957 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.412043 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.412260 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.412359 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.412578 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.412664 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.412896 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.413001 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.413146 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.413240 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.413449 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.413549 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.413696 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.413835 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.414046 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.414149 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.414365 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.414458 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.414651 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.414749 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.414906 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.414998 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.415227 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.415321 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.415541 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.415634 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.415848 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.415939 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.416147 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.416238 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.416448 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.416535 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.416749 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.416833 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.417054 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.417144 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.417360 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.417485 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.417665 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.417748 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.417989 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.418092 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.418307 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.418402 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.418622 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.418715 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.418928 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.419018 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.419232 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.419328 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.419559 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.419690 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.419871 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.419977 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.420174 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.420288 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.420513 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.420631 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.420804 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.420912 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.421106 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.421209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.421407 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.421510 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.421708 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.421820 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.422045 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.422146 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.422382 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.422491 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.422681 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.422788 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.422930 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.423033 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.423772 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.423993 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.424107 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.424330 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.424430 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.424637 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.424728 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.424890 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.424989 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.425195 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.425284 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.425502 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.425593 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.425822 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.425974 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.426151 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.426236 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.426456 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.426552 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.426760 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.426859 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.427059 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.427144 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.427359 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.427444 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.427658 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.427751 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.427961 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.428055 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.428262 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.428354 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.428563 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.428657 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.428868 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.428958 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.429173 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.429268 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.429472 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.429570 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.429774 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.429873 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.430100 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.430249 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.430403 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.430567 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.430718 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.430805 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.431018 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.431111 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.431320 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.431413 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.431622 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.431719 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.431923 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.432016 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.432222 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.432314 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.432531 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.432621 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.432831 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.432922 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.433134 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.433244 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.433443 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.433531 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.433737 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.433827 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.434062 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.434243 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.434377 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.434463 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.434680 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.434765 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.434980 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.435073 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.435278 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.435374 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.435575 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.435659 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.435877 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.435970 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.436175 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.436267 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.436470 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.436563 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.436765 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.436850 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.437058 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.437150 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.437456 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.437666 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.437751 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.437989 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.438079 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.438292 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.438388 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.438588 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.438672 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.438926 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.439011 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.439247 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.439343 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.439557 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.439650 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.439865 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.439949 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.440170 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.440256 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.440491 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:51:25.440579 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.440824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.440908 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.441140 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.441234 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.441451 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.441535 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.441760 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.441851 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.442106 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.442200 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.442415 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.442499 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.442720 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.442814 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.443026 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.443111 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.443340 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.443428 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.443654 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.443751 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.443978 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.444061 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.444286 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.444380 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.444596 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.444693 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.444906 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.444997 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.445212 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.445342 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.445525 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.445620 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.445843 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.445948 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.446186 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.446282 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.446494 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.446593 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.446804 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.446890 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.447129 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.447214 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.447450 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.447542 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.447770 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.447855 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.448083 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.448168 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.448389 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.448475 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.448694 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.448787 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.449000 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.449086 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.449334 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.449421 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.449643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.449728 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.449979 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.450069 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.450299 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.450386 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.450611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.450701 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.450928 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.451022 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.451237 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.451324 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.451542 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.451629 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.451852 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.452017 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.452160 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.452247 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.452465 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.452552 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.452785 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.452882 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.453096 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.453182 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.453408 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.453498 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.453718 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.453819 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.454051 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.454139 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.454392 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.454491 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.454711 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.454809 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.455020 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.455113 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.455328 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.455413 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.455630 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.455723 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.455936 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.456028 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.456238 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.456323 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.456544 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.456631 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.456844 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.456955 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.457152 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.457237 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.457463 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.457550 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.457764 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.457847 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.458102 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.458198 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.458410 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.458505 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.458718 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.458803 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.459025 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.459116 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.459332 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.459419 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.459633 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.459718 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.459940 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.460034 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.460245 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.460330 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.460548 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.460632 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.460867 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.460962 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.461170 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.461254 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.461472 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.461558 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.461782 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.461873 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.462106 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.462192 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.462409 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.462493 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.462720 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.462817 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.463028 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.463111 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.463333 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.463416 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.463643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.463730 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.463948 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.464031 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.464264 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.464355 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.464573 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.464665 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.464880 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.464974 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.465193 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.465284 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.465508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.465595 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.465814 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.465918 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.466161 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.466247 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.466473 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.466567 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.466781 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.466874 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.467082 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.467177 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.467387 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.467480 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.467686 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.467771 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.467987 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.468090 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.468286 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.468373 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.468591 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.468682 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.468890 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.468984 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.469190 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.469281 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.469489 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.469574 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.469788 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.469882 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.470641 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.470736 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.470953 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.471061 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.471257 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.471352 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.471556 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.471640 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.471856 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.471948 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.472155 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.472289 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.472477 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.472561 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.472778 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.472868 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.473082 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.473167 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.473389 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.473475 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.473695 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.473778 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.474059 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.474147 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.474369 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.474454 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.474678 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.474773 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.474984 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.475075 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.475291 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.475376 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.475599 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.475692 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.475907 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.475999 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.476223 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.476308 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.476536 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.476628 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.476849 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.476933 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.477155 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.477241 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.477465 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.477557 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.477769 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.477859 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.478111 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.478208 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.478414 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.478510 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.478724 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.478816 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.479047 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.479137 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.479360 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.479447 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.479675 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.479758 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.479981 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.480063 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.480299 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.480395 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.480597 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.480682 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.480903 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.480987 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.481213 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.481301 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.481520 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.481608 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.481826 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.481930 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.482170 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.482258 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.482479 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.482564 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.482794 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.482892 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.483106 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.483190 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.483421 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.483506 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.483743 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.483836 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.484055 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.484146 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.484356 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.484448 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.484669 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.484764 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.484992 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.485077 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.485304 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.485387 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.485637 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.486318 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.486509 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.486598 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.486830 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.486914 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.487138 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.487233 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.487446 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.487531 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.487754 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.487839 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.488058 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.488151 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.488360 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.488447 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.488666 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.488751 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.488977 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.489064 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.489283 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.489367 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.489590 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.489673 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.489889 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.490004 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.490221 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.490308 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.490770 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.490872 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.491078 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.491165 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.491380 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.491466 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.491689 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.491782 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.492006 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.492098 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.492317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.492400 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.492624 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.492719 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.492932 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.493029 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.493232 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.493326 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.493536 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.493630 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.493858 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.493960 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.494201 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.494284 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.494505 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.494602 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.494808 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.494893 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.495110 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.495197 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.495434 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.495519 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.495744 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.495881 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.496048 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.496135 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.496355 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.496441 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.496666 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.496750 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.496970 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.497061 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.497281 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.497368 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.497589 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.497673 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.497896 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.498018 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.498238 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.498326 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.498548 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.498640 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.498854 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.498953 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.499161 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.499256 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.499467 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.499552 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.499775 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.499872 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.500083 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.500169 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.500393 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.500476 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.500695 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.500788 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.501003 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.501087 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.501333 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.501419 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.501636 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.501731 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.501963 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.502052 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.502280 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.502364 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.502650 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.502839 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.502968 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.503169 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.503279 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.503481 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.503577 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.503794 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.503925 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.504135 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.504449 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.504544 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.504772 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.504861 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.505091 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.505174 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.505400 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.505484 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.505703 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.505797 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.506032 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.506197 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.506339 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.506425 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.506642 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.506727 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.506948 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.507041 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.507248 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.507346 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.507551 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.507638 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.507851 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.507981 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.508154 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.508239 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.508452 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.508537 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.508752 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.508839 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.509051 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.509135 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.509351 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.509450 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.509662 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.509759 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.509984 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.510084 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.510290 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.510387 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.510586 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.510671 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.510893 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.510976 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.511195 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.511288 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.511495 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.511582 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.511795 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.511887 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.512096 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.512189 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.512418 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.512501 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.512719 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.512802 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.513023 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.513108 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.513329 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.513413 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.513636 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.513720 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.514004 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.514095 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.514308 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.514394 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.514627 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.514711 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.514928 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.515052 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.515231 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.515323 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.515531 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.515626 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.515834 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.515927 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.516138 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.516223 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.516441 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.516534 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.516748 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.516840 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.517567 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.517659 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.517876 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.518072 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.518206 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.518292 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.518508 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.518595 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.518814 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.518912 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.519116 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.519204 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.519425 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.519518 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.519731 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.519826 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.520033 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.520126 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.520335 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.520427 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.520641 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.520726 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.520944 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.521027 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.521245 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.521331 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.521550 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.521636 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.521849 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.521951 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.522187 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.522282 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.522489 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.522576 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.522790 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.522874 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.523091 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.523175 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.523398 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.523484 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.523699 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.523782 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.524000 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.524156 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.524311 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.524403 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.524617 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.524700 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.524917 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.525010 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.525217 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.525305 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.525520 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.525604 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.525817 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.525944 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.526144 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.526248 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.526452 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.526538 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.526764 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.526856 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.527080 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.527164 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.527378 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.527469 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.527684 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.527770 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.527982 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.528065 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.528281 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.528369 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.528581 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.528668 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.528884 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.528969 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.529181 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.529273 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.529480 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.529567 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.529779 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.529866 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.530102 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.530204 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.530404 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.530492 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.530709 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.530792 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.531014 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.531108 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.531314 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.531398 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.531616 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.531702 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.531916 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.532009 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.532240 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.532331 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.532600 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.533184 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.533409 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.533503 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.533719 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.533805 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.534055 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.534142 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.534401 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.534498 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.534708 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.534801 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.535014 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.535156 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.535359 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.535449 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.535614 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.535709 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.535925 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.536018 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.536234 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.536328 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.536544 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.536631 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.536845 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.536932 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.537149 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.537236 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.537466 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.537551 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.537773 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.537866 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.538104 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.538194 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.538410 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.538493 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.538717 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.538822 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.539032 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.539118 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.539332 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.539425 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.539636 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.539733 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.539943 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.540028 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.540245 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.540331 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.540566 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.540711 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.540853 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.540951 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.541160 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.541246 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.541467 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.541561 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.541774 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.541867 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.542107 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.542192 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.542411 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.542506 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.542710 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.542795 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.543013 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.543105 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.543317 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.543415 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.543616 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.543701 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.543926 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.544018 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.544227 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.544313 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.544526 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.544617 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.544831 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.544916 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.545132 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.545225 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.545439 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.545540 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.545738 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.545835 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.546067 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.546182 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.546379 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.546474 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.546687 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.546780 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.546999 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.547084 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.547306 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.547398 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.547662 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.547761 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.547973 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.548059 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.548309 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.548404 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.548610 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.548708 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.548952 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.549037 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.549268 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.549359 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.549587 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.549686 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.549911 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.549999 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.550221 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.550307 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.550522 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.550639 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.550829 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.550956 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.551148 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.551270 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.551450 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.551583 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.551750 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.551896 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.552051 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.552203 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.552369 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.552518 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.552671 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.552845 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.552987 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.553151 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.553398 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.553485 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.553706 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.553790 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.554034 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.554138 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.554396 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.554480 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.554723 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.554809 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.555035 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.555133 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.555354 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.555477 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.555672 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.555764 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.555992 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.556140 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.556292 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.556453 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.556603 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.556766 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.556914 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.557092 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.557232 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.557418 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.557549 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.557746 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.557859 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.558079 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.558177 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.558397 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.558492 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.558709 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.558794 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.559037 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.559132 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.559361 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.559445 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.559678 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.559762 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.559994 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.560088 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.560301 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.560386 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.560625 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.560712 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.560950 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.561043 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.561265 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.561350 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.561586 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.561670 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.561893 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.562040 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.562222 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.562342 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.562527 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.562656 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.562831 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.562980 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.563154 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.563310 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.563461 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.563621 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.563794 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.563963 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.564108 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.564277 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.564417 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.564587 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.564718 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.564896 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.565018 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.565224 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.565340 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.565536 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.565641 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.565852 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.565986 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.566192 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.566279 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.566504 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.566635 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.566812 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.566899 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.567117 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.567201 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.567444 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.567530 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.567752 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.567861 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.568084 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.568232 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.568394 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.568548 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.568678 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.568823 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.568996 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.569159 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.569307 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.569461 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.569603 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.569741 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.569927 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.570103 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.570241 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.570388 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.570532 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.570620 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.570840 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.570935 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.571166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.571251 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.571479 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.571574 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.571789 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.571962 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.572113 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.572271 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.572418 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.572565 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.572730 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.572879 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.573023 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.573160 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.573306 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.573446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.573597 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.573723 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.574018 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.574107 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.574345 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.574442 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.574650 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.574738 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.574951 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.575036 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.575253 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.575338 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.575552 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.575646 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.575862 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.575937 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.576161 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.576254 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.576470 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.576554 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.576775 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.576849 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.577082 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.577174 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.577381 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.577466 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.577686 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.577877 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.578052 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.578245 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.578363 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.578547 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.578693 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.578875 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.579007 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.579184 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.579317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.580160 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.580244 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.580471 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.580586 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.580823 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.580979 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.581144 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.581299 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.581445 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.581703 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.581863 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.582056 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.582209 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.582355 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.582518 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.582782 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.582932 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.583074 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.583231 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.583386 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.583524 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.583672 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.583760 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.583838 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.583973 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.584238 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.584334 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.584552 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.584645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.584867 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.584951 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.585180 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.585274 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.585491 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.585643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.585804 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.586053 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.586156 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.586388 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.586679 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.586764 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.586994 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.587081 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.587304 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.587399 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.587612 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.587698 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.588018 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.588241 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.588336 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.588556 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.588649 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.588871 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.588957 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.589183 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.589269 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.589494 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.589579 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.589803 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.589888 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.590140 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.590229 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.590487 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.590579 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.590798 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.590894 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.591101 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.591188 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.591410 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.591496 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.591723 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.591824 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.592035 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.592122 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.592343 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.592437 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.592650 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.592738 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.592959 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.593046 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.593266 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.593351 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.593573 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.593661 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.593880 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.594024 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.594211 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.594309 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.594521 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.594614 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.594835 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.594918 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.595689 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.595801 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.596003 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.596141 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.596311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.596398 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.596623 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.596718 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.596936 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.597029 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.597273 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.597448 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.597596 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.597759 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.597928 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.598113 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.598252 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.598442 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.598573 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.598764 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.599079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.599165 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.599393 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.599485 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.599718 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.599812 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.600023 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.600116 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.600326 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.600412 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.600634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.600722 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.600942 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.601028 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.601243 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.601337 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.601562 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.601649 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.601870 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.601974 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.602197 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.602300 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.602513 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.602606 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.602818 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.602905 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.603143 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.603344 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.603460 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.603688 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.603781 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.604002 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.604087 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.604325 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.604412 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.604646 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.604895 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.604987 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.605247 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.605341 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.605565 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.605651 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.605869 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.606002 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.606198 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.606297 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.606511 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.606597 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.606819 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.606912 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.607122 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.607219 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.607422 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.607508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.607727 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.607820 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.608033 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.608120 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.608339 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.608425 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.608645 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.608737 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.608945 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.609083 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.609255 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.609340 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.609559 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.609652 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.609863 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.609980 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.610188 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.610281 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.610498 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.610592 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.610826 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.610913 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.611128 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.611222 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.611430 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.611526 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.611732 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.611817 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.612041 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.612140 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.612343 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.612431 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.612650 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.612734 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.612951 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.613043 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.613257 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.613343 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.613574 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.613661 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.613884 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.613988 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.614212 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.614299 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.614520 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.614604 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.614824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.614915 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.615127 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.615214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.615439 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.615778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.616002 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.616098 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.616323 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.616410 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.616634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.616720 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.616942 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.617035 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.617260 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.617357 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.617594 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.617689 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.617922 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.618128 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.618313 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.618471 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.618631 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.618792 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.618983 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.619124 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.619304 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.619454 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.619761 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.619847 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.620066 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.620156 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.620371 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.620457 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.620694 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.620780 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.621003 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.621112 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.621312 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.621425 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.621619 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.621735 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.621945 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.622074 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.622255 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.622409 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.622565 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.622725 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.622874 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.623040 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.623180 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.623355 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.623486 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.623669 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.623791 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.623983 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.624132 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.624298 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.624384 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.624610 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.624697 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.624923 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.625009 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.625235 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.625321 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.625547 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.625646 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.625859 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.625961 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.626196 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.626315 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.626545 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.626633 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.626858 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.626942 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.627164 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.627302 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.627470 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.627557 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.627776 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.627869 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.628083 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.628178 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.628399 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.628484 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.628724 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.628811 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.629036 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.629121 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.629337 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.629426 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.629651 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.629987 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.630088 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.630308 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.630395 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.630642 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.630728 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.630959 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.631056 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.631265 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.631350 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.631588 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.631909 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.632003 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.632219 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.632307 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.632538 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.632624 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.632848 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.632942 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.633176 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.633263 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.633513 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.633605 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.633838 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.633946 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.634184 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.634268 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.634494 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.634578 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.634798 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.634892 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.635100 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.635185 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.635406 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.635498 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.635722 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.635810 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.636029 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.636199 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.636333 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.636410 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.636634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.636722 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.636941 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.637027 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.637242 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.637387 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.637543 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.637630 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.637845 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.637992 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.638174 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.638271 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.638487 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.638583 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.638790 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.638875 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.639091 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.639191 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.639390 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.639476 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.639690 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.639775 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.639991 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.640086 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.640290 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.640376 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.640594 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.640680 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.640896 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.640984 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.641199 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.641283 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.641498 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.641592 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.641798 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.642417 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.642645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.642742 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.642959 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.643050 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.643269 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.643356 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.643579 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.643665 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.643934 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.644028 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.644195 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.644281 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.644500 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.644584 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.644808 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.644901 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.645128 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.645214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.645446 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.645533 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.645760 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.645853 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.646093 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.646181 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.646418 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.646549 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.646725 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.646825 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.647035 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.647128 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.647346 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.647439 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.647652 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.647746 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.647958 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.648051 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.648264 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.648357 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.648587 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.648683 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.648899 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.648984 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.649205 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.649291 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.649519 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.649614 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.649831 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.649934 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.650172 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.650257 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.650482 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.650569 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.650791 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.650878 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.651116 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.651210 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.651422 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.651507 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.651727 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.651815 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.652032 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.652126 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.652338 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.652425 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.652644 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.652737 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.652953 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.653048 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.653268 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.653354 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.653577 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.653670 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.653889 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.654009 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.654221 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.654307 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.654534 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.654618 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.654855 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.654942 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.655161 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.655246 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.655473 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.655560 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.655793 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.655879 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.656108 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.656199 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.656436 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.656520 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.656764 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.656849 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.657079 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.657165 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.657389 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.657500 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.658277 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.658382 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.658621 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.658708 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.658868 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:51:25.658964 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.659276 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.659611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.659929 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.660246 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.660556 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:51:25.660802 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:51:25.810644 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO dbcounter [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Registered counter for database nova_api Sep 24 14:51:25.812294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO dbcounter [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Registered counter for database nova_api Sep 24 14:51:25.833053 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:51:25.834862 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_db.sqlalchemy.engines [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:51:25.839858 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writer thread running {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:51:25.841299 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writer thread running {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:51:25.897075 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.context [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15cdcebc-e767-48fd-9484-d2808c084625(cell1) {{(pid=105414) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 14:51:25.899165 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.context [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15cdcebc-e767-48fd-9484-d2808c084625(cell1) {{(pid=105415) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 14:51:25.900865 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:51:25.901331 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:51:25.902901 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:51:25.903010 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_concurrency.lockutils [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:51:25.903443 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_concurrency.lockutils [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:51:25.903617 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:51:25.904054 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:51:25.904991 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_concurrency.lockutils [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:51:25.905710 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_concurrency.lockutils [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:51:25.906047 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:51:25.906180 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_concurrency.lockutils [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:51:25.908038 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO dbcounter [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Registered counter for database nova_cell0 Sep 24 14:51:25.908502 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_concurrency.lockutils [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:51:25.910532 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO dbcounter [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Registered counter for database nova_cell0 Sep 24 14:51:25.911970 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO dbcounter [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Registered counter for database nova_cell1 Sep 24 14:51:25.914477 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO dbcounter [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Registered counter for database nova_cell1 Sep 24 14:51:25.920095 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:51:25.921929 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:51:25.924220 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_db.sqlalchemy.engines [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:51:25.926859 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_db.sqlalchemy.engines [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:51:25.928809 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writer thread running {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:51:25.933164 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writer thread running {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:51:26.063667 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writer thread running {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:51:26.074196 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO dbcounter [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Registered counter for database nova_cell0 Sep 24 14:51:26.079131 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writer thread running {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:51:26.081770 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:51:26.086496 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writer thread running {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:51:26.089843 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO dbcounter [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Registered counter for database nova_cell0 Sep 24 14:51:26.096541 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG oslo_db.sqlalchemy.engines [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:51:26.101267 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writer thread running {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:51:26.423485 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: WARNING keystonemiddleware.auth_token [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:51:26.430708 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: WARNING keystonemiddleware.auth_token [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:51:26.432406 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: WARNING keystonemiddleware.auth_token [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:51:26.439669 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: WARNING keystonemiddleware.auth_token [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:51:26.770857 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: WARNING keystonemiddleware.auth_token [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:51:26.776771 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: WARNING keystonemiddleware.auth_token [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:51:26.780785 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: WARNING keystonemiddleware.auth_token [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:51:26.782057 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55afac32f9c0 pid: 105414 (default app) Sep 24 14:51:26.784160 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:51:26.785331 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Sep 24 14:51:26.785743 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Sat Sep 24 14:51:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:51:26.786850 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: WARNING keystonemiddleware.auth_token [None req-22fc5167-0671-418c-8359-89d0c4220866 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:51:26.792100 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55afac32f9c0 pid: 105415 (default app) Sep 24 14:52:47.805340 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:52:47.806284 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 24 14:52:47.806673 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:52:47.818989 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writing DB stats nova_api:SELECT=3 {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:52:47.820327 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writing DB stats nova_cell1:SELECT=3 {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:52:47.821151 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writing DB stats nova_cell0:SELECT=3 {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:52:47.823196 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:52:48.683086 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-2086207b-475c-4fb1-bcba-1f8a4a25d843 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:52:48.715855 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-2086207b-475c-4fb1-bcba-1f8a4a25d843 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.902508 Sep 24 14:52:48.716603 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1292 bytes} [Sat Sep 24 14:52:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:52:51.347979 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:52:51.349029 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-d9ffe1af-40d9-41a8-9fed-394c549dd2a1 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Sep 24 14:52:51.350238 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:52:51.807909 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-4c84fb53-4194-4ebe-be0a-2eca0c44a039 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "ram": 256, "swap": 0}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:52:51.855583 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-4c84fb53-4194-4ebe-be0a-2eca0c44a039 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.499885 Sep 24 14:52:51.856141 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:52:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:52:51.870220 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:SELECT=3 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:52:51.872205 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell1:SELECT=3 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:52:51.874203 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell0:SELECT=3 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:52:51.875498 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:52:52.087030 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-3aebc36b-5bed-426e-bfc0-6ea6c11473ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:52:52.156283 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-3aebc36b-5bed-426e-bfc0-6ea6c11473ae admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291596 Sep 24 14:52:52.156889 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Sep 24 14:52:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:52:54.753038 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-4c84fb53-4194-4ebe-be0a-2eca0c44a039 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:52:54.754847 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-4c84fb53-4194-4ebe-be0a-2eca0c44a039 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Sep 24 14:52:54.755584 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:52:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:52:55.412154 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-b56a9176-fb71-4699-845b-1f6974701c16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 5}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:52:55.455916 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-b56a9176-fb71-4699-845b-1f6974701c16 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.693587 Sep 24 14:52:55.457224 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:52:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:52:55.469279 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-39cad914-ebd9-4259-9d81-9f39076aadc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:52:55.510145 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-39cad914-ebd9-4259-9d81-9f39076aadc3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044574 Sep 24 14:52:55.510738 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Sep 24 14:52:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:52:58.139849 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-b56a9176-fb71-4699-845b-1f6974701c16 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:52:58.140914 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-b56a9176-fb71-4699-845b-1f6974701c16 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 24 14:52:58.141554 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:52:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:52:58.561506 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-55fb927d-b85d-4e78-9af0-d7bea09bad7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "disk": 10}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:52:58.582012 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-55fb927d-b85d-4e78-9af0-d7bea09bad7b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433777 Sep 24 14:52:58.582592 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:52:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:52:58.596600 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-857b0ef3-5c49-49d2-b680-8d62b150eeea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:52:58.626316 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-857b0ef3-5c49-49d2-b680-8d62b150eeea admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034516 Sep 24 14:52:58.626901 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Sep 24 14:52:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:53:01.243435 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-55fb927d-b85d-4e78-9af0-d7bea09bad7b admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:01.244434 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-55fb927d-b85d-4e78-9af0-d7bea09bad7b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 24 14:53:01.244831 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:53:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:01.656134 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-13829160-acc6-48cb-a458-596be7e71534 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:01.681179 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-13829160-acc6-48cb-a458-596be7e71534 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430256 Sep 24 14:53:01.682590 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:53:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:53:01.694308 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-98e05a2a-c864-4bec-8f09-c4ae925f394b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:01.721876 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-98e05a2a-c864-4bec-8f09-c4ae925f394b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031129 Sep 24 14:53:01.722475 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Sep 24 14:53:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:53:04.323276 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-13829160-acc6-48cb-a458-596be7e71534 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:04.324295 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-13829160-acc6-48cb-a458-596be7e71534 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 24 14:53:04.324696 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:53:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:04.792987 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-b6ae4a5c-84f5-4882-9b7d-04a2dde6a200 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "disk": 20, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:04.813359 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-b6ae4a5c-84f5-4882-9b7d-04a2dde6a200 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482459 Sep 24 14:53:04.813971 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:53:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:53:04.827305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-ed191572-934a-4886-baca-cf4fbaf824a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:04.858430 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-ed191572-934a-4886-baca-cf4fbaf824a9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035451 Sep 24 14:53:04.865932 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1336 bytes} [Sat Sep 24 14:53:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:53:07.514957 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-b6ae4a5c-84f5-4882-9b7d-04a2dde6a200 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:07.516063 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-b6ae4a5c-84f5-4882-9b7d-04a2dde6a200 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Sep 24 14:53:07.516552 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:07.926635 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-ed0dcf89-b609-48f4-81b0-a977efe78041 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:07.952124 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-ed0dcf89-b609-48f4-81b0-a977efe78041 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.428956 Sep 24 14:53:07.952668 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1292 bytes} [Sat Sep 24 14:53:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:53:10.521188 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-b6ae4a5c-84f5-4882-9b7d-04a2dde6a200 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:10.522229 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-b6ae4a5c-84f5-4882-9b7d-04a2dde6a200 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 24 14:53:10.522631 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:53:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:10.915670 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-67249f30-c139-4bf8-b70e-775690775297 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 512}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:10.935547 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-67249f30-c139-4bf8-b70e-775690775297 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.406936 Sep 24 14:53:10.936092 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:53:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:53:10.948520 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-25e09dbf-65f7-451f-94af-47b9737cb3c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:10.975408 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-25e09dbf-65f7-451f-94af-47b9737cb3c8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030524 Sep 24 14:53:10.975978 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Sep 24 14:53:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:53:13.560026 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-67249f30-c139-4bf8-b70e-775690775297 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:13.561875 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-67249f30-c139-4bf8-b70e-775690775297 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002247 Sep 24 14:53:13.562549 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:53:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:13.951258 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-31248429-853f-4a85-84ba-2092bc709711 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:13.970579 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-31248429-853f-4a85-84ba-2092bc709711 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.401214 Sep 24 14:53:13.971127 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:53:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:53:13.982970 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-b04a9fdd-172e-43d9-93b0-2bda38f89921 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:14.007266 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-b04a9fdd-172e-43d9-93b0-2bda38f89921 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027904 Sep 24 14:53:14.007850 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Sep 24 14:53:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:53:16.681207 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-31248429-853f-4a85-84ba-2092bc709711 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:16.684324 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-31248429-853f-4a85-84ba-2092bc709711 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004689 Sep 24 14:53:16.684844 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:53:16 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:17.166402 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-2348522b-709d-41d3-be21-84e02381a2ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "swap": 0, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:17.194416 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-2348522b-709d-41d3-be21-84e02381a2ad admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.497950 Sep 24 14:53:17.196052 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:53:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:53:17.208154 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-4ef6ecff-7944-4123-b168-2019b05dc29c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:17.238997 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-4ef6ecff-7944-4123-b168-2019b05dc29c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035124 Sep 24 14:53:17.239904 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Sep 24 14:53:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:53:19.840880 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-2348522b-709d-41d3-be21-84e02381a2ad admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:19.841809 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-2348522b-709d-41d3-be21-84e02381a2ad admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 24 14:53:19.842514 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:53:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:20.287984 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-9f61ee69-c79c-48a7-9963-8b3d573545d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "ram": 8192, "swap": 0, "id": "4"}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:20.293993 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:53:20.311882 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-9f61ee69-c79c-48a7-9963-8b3d573545d3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462406 Sep 24 14:53:20.312818 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:53:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 14:53:20.325025 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-23e020a1-917d-4da9-bdff-4b8652a7aebe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:20.362682 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-23e020a1-917d-4da9-bdff-4b8652a7aebe admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041244 Sep 24 14:53:20.363281 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Sep 24 14:53:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:53:23.000555 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-9f61ee69-c79c-48a7-9963-8b3d573545d3 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:23.001570 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-9f61ee69-c79c-48a7-9963-8b3d573545d3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 24 14:53:23.005985 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:53:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:23.438241 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-2eff5116-9991-4207-b1a9-f9a2ca0d2317 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:23.445471 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:53:23.463296 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-2eff5116-9991-4207-b1a9-f9a2ca0d2317 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455136 Sep 24 14:53:23.463965 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1283 bytes} [Sat Sep 24 14:53:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 14:53:23.481773 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-52c72756-73ad-47df-ab44-17cb2bec7912 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:23.516096 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-52c72756-73ad-47df-ab44-17cb2bec7912 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037164 Sep 24 14:53:23.518307 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1333 bytes} [Sat Sep 24 14:53:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:53:40.208238 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-2eff5116-9991-4207-b1a9-f9a2ca0d2317 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:40.209158 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-2eff5116-9991-4207-b1a9-f9a2ca0d2317 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 24 14:53:40.209562 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:40.220090 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:53:40.594776 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-28f0f505-6df1-4f65-8b0b-15e809665387 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:40.612954 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-28f0f505-6df1-4f65-8b0b-15e809665387 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397379 Sep 24 14:53:40.613473 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1292 bytes} [Sat Sep 24 14:53:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:53:41.912465 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-2eff5116-9991-4207-b1a9-f9a2ca0d2317 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:41.913502 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-2eff5116-9991-4207-b1a9-f9a2ca0d2317 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 24 14:53:41.913913 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:42.431936 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-02817c88-c6fc-422b-b74a-a69fded969f2 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:42.437161 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.wsgi [None req-02817c88-c6fc-422b-b74a-a69fded969f2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-02817c88-c6fc-422b-b74a-a69fded969f2 admin admin] Request method failure captured: Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Accept: application/json Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Accept-Encoding: gzip, deflate Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Connection: keep-alive Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Content-Length: 0 Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Host: 10.222.0.61 Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Openstack-Api-Version: compute 2.92 Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Openstack-System-Scope: None Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: User-Agent: python-novaclient Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Auth-Token: gAAAAABjLxn16lRKXa53UGQtW2-EIh1IvDLisED1Sn4_BWcupbAGmfVNk0ztfzplHWze-kglwyJXfH1zp__0380pHeV5Z82ZHBQ-_UGspE7DC8WKPxozi--5QRJJwXkaSfIbDFlCz_j_0Y_OUVYjDgtzuVz9i5h8pSB3UOr834THuFeB4rmS67g Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Domain-Id: None Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Domain-Name: None Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Identity-Status: Confirmed Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Is-Admin-Project: True Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Domain-Id: default Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Domain-Name: Default Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Name: admin Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Role: admin,reader,member Sep 24 14:53:42.440446 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Roles: admin,reader,member Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}] Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Tenant: admin Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Tenant-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Tenant-Name: admin Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User: admin Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Domain-Id: default Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Domain-Name: Default Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Id: 3ea61b3146144581bb15be72dcc836fe Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Name: admin Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: method: > Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: exception: Flavor 42 could not be found. Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: action_args: {'id': '42'} Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:53:42.442209 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:42.444294 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.445658 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-02817c88-c6fc-422b-b74a-a69fded969f2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:53:42.447180 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-02817c88-c6fc-422b-b74a-a69fded969f2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390260 Sep 24 14:53:42.447180 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Sat Sep 24 14:53:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:53:42.451803 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-5d5104ed-b39a-47aa-afe1-9d11b50d3138 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:42.475480 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-5d5104ed-b39a-47aa-afe1-9d11b50d3138 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027028 Sep 24 14:53:42.476038 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Sep 24 14:53:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:53:42.487087 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-a1c90f3a-cad8-4a4a-bdd0-1343adab49ec admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:42.508788 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-a1c90f3a-cad8-4a4a-bdd0-1343adab49ec admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026721 Sep 24 14:53:42.509328 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Sep 24 14:53:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:53:42.518521 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-a1909369-7510-4df7-8b9d-37b3920384f4 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:42.524113 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.wsgi [None req-a1909369-7510-4df7-8b9d-37b3920384f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-a1909369-7510-4df7-8b9d-37b3920384f4 admin admin] Request method failure captured: Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Accept: application/json Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Accept-Encoding: gzip, deflate Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Connection: keep-alive Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Content-Length: 0 Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Host: 10.222.0.61 Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Openstack-Api-Version: compute 2.92 Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Openstack-System-Scope: None Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: User-Agent: python-novaclient Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Auth-Token: gAAAAABjLxn16lRKXa53UGQtW2-EIh1IvDLisED1Sn4_BWcupbAGmfVNk0ztfzplHWze-kglwyJXfH1zp__0380pHeV5Z82ZHBQ-_UGspE7DC8WKPxozi--5QRJJwXkaSfIbDFlCz_j_0Y_OUVYjDgtzuVz9i5h8pSB3UOr834THuFeB4rmS67g Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Domain-Id: None Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Domain-Name: None Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Identity-Status: Confirmed Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Is-Admin-Project: True Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Domain-Id: default Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Domain-Name: Default Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Name: admin Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Role: admin,reader,member Sep 24 14:53:42.527824 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Roles: admin,reader,member Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}] Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Tenant: admin Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Tenant-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Tenant-Name: admin Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User: admin Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Domain-Id: default Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Domain-Name: Default Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Id: 3ea61b3146144581bb15be72dcc836fe Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Name: admin Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: method: > Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: exception: Flavor 42 could not be found. Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: action_args: {'id': '42'} Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:53:42.529361 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:42.537311 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:42.538634 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-a1909369-7510-4df7-8b9d-37b3920384f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:53:42.539865 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-a1909369-7510-4df7-8b9d-37b3920384f4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014226 Sep 24 14:53:42.539865 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Sat Sep 24 14:53:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 24 14:53:43.736317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-a1c90f3a-cad8-4a4a-bdd0-1343adab49ec admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:43.737332 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-a1c90f3a-cad8-4a4a-bdd0-1343adab49ec admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 24 14:53:43.737728 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:53:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:44.261502 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-007a7c00-f7e2-4f14-b352-21e0641bbf01 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:44.266566 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.wsgi [None req-007a7c00-f7e2-4f14-b352-21e0641bbf01 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-007a7c00-f7e2-4f14-b352-21e0641bbf01 admin admin] Request method failure captured: Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Accept: application/json Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Accept-Encoding: gzip, deflate Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Connection: keep-alive Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Content-Length: 0 Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Host: 10.222.0.61 Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Openstack-Api-Version: compute 2.92 Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Openstack-System-Scope: None Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: User-Agent: python-novaclient Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Auth-Token: gAAAAABjLxn3MeXiwxPGDCmnqLLvjMjck71wm8pFTwzyA76qN52QxagWjtrd6pcJZRvKm5VwQGS2fiTkuGRCCQqgCqeOyt2tJ2KO2r84og2MBjXP-SEaEBurG1SIP3WFYX01zg_OFnWVXsrr17PqhcIUogmSWe0VgnRnmoT0_0tHrNDoXLuYL7w Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Domain-Id: None Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Domain-Name: None Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Identity-Status: Confirmed Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Is-Admin-Project: True Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Domain-Id: default Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Domain-Name: Default Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Name: admin Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Role: admin,reader,member Sep 24 14:53:44.268079 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Roles: admin,reader,member Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}] Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Tenant: admin Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Tenant-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Tenant-Name: admin Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User: admin Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Domain-Id: default Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Domain-Name: Default Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Id: 3ea61b3146144581bb15be72dcc836fe Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Name: admin Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: method: > Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: exception: Flavor 84 could not be found. Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: action_args: {'id': '84'} Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:53:44.269645 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:44.270643 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.272202 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-007a7c00-f7e2-4f14-b352-21e0641bbf01 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:53:44.273455 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-007a7c00-f7e2-4f14-b352-21e0641bbf01 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390717 Sep 24 14:53:44.273455 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Sat Sep 24 14:53:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:53:44.279440 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-a09cf4a6-c001-4079-9b93-594e7cd1f6b0 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:44.294566 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-a09cf4a6-c001-4079-9b93-594e7cd1f6b0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018926 Sep 24 14:53:44.295098 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Sep 24 14:53:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:53:44.306323 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-1f2f1bc0-0571-4b80-986a-693fd3ceaf61 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:44.322197 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-1f2f1bc0-0571-4b80-986a-693fd3ceaf61 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020647 Sep 24 14:53:44.322718 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Sep 24 14:53:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:53:44.331767 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-88e0760c-0729-4e2c-adb7-5312af2beb42 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:44.336694 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.wsgi [None req-88e0760c-0729-4e2c-adb7-5312af2beb42 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-88e0760c-0729-4e2c-adb7-5312af2beb42 admin admin] Request method failure captured: Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Accept: application/json Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Accept-Encoding: gzip, deflate Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Connection: keep-alive Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Content-Length: 0 Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Host: 10.222.0.61 Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Openstack-Api-Version: compute 2.92 Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Openstack-System-Scope: None Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: User-Agent: python-novaclient Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Auth-Token: gAAAAABjLxn3MeXiwxPGDCmnqLLvjMjck71wm8pFTwzyA76qN52QxagWjtrd6pcJZRvKm5VwQGS2fiTkuGRCCQqgCqeOyt2tJ2KO2r84og2MBjXP-SEaEBurG1SIP3WFYX01zg_OFnWVXsrr17PqhcIUogmSWe0VgnRnmoT0_0tHrNDoXLuYL7w Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Domain-Id: None Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Domain-Name: None Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Identity-Status: Confirmed Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Is-Admin-Project: True Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Domain-Id: default Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Domain-Name: Default Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Name: admin Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Role: admin,reader,member Sep 24 14:53:44.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Roles: admin,reader,member Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}] Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Tenant: admin Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Tenant-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Tenant-Name: admin Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User: admin Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Domain-Id: default Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Domain-Name: Default Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Id: 3ea61b3146144581bb15be72dcc836fe Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Name: admin Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: method: > Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: exception: Flavor 84 could not be found. Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: action_args: {'id': '84'} Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:53:44.339611 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:44.340508 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:44.341643 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-88e0760c-0729-4e2c-adb7-5312af2beb42 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:53:44.342683 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-88e0760c-0729-4e2c-adb7-5312af2beb42 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011290 Sep 24 14:53:44.342683 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Sat Sep 24 14:53:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:53:45.548439 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-1f2f1bc0-0571-4b80-986a-693fd3ceaf61 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:45.549436 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-1f2f1bc0-0571-4b80-986a-693fd3ceaf61 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Sep 24 14:53:45.549826 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:46.074837 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-0eadf7f1-5ae1-47c4-844e-48dbb0db895e admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:46.081275 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.wsgi [None req-0eadf7f1-5ae1-47c4-844e-48dbb0db895e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-0eadf7f1-5ae1-47c4-844e-48dbb0db895e admin admin] Request method failure captured: Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Accept: application/json Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Accept-Encoding: gzip, deflate Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Connection: keep-alive Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Content-Length: 0 Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Host: 10.222.0.61 Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Openstack-Api-Version: compute 2.92 Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Openstack-System-Scope: None Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: User-Agent: python-novaclient Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Auth-Token: gAAAAABjLxn5iJHEBvHYfQnoVCO01NUZ3DPDtkj_GJsL76thVswruf4YHmUmPW1X3Gqpn65JswhdlB_iqw_6qugXNQO_vzF4-e7kofwuhoj23nmlCk9p-CNtHk7EY5WKYiqqqfb9m0a7dHxTRigk1PvQLlJeNX_8MCXWIS4YnVmbsePugRIzBS8 Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Domain-Id: None Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Domain-Name: None Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Identity-Status: Confirmed Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Is-Admin-Project: True Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Domain-Id: default Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Domain-Name: Default Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Project-Name: admin Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Role: admin,reader,member Sep 24 14:53:46.082799 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Roles: admin,reader,member Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}] Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Tenant: admin Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Tenant-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-Tenant-Name: admin Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User: admin Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Domain-Id: default Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Domain-Name: Default Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Id: 3ea61b3146144581bb15be72dcc836fe Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: X-User-Name: admin Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: method: > Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: exception: Flavor 451 could not be found. Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: action_args: {'id': '451'} Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:53:46.084315 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:46.085317 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.086778 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-0eadf7f1-5ae1-47c4-844e-48dbb0db895e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:53:46.087986 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-0eadf7f1-5ae1-47c4-844e-48dbb0db895e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398737 Sep 24 14:53:46.087986 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Sep 24 14:53:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 14:53:46.093970 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-398e0286-5469-4a26-9f7c-335877085839 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:46.108782 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-398e0286-5469-4a26-9f7c-335877085839 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018486 Sep 24 14:53:46.109317 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Sep 24 14:53:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:53:46.118690 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:46.133629 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018681 Sep 24 14:53:46.134192 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Sat Sep 24 14:53:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 14:53:46.143630 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-70e29b71-d042-4c99-8a80-6b68fd8d24ed admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:46.148494 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.wsgi [None req-70e29b71-d042-4c99-8a80-6b68fd8d24ed admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-70e29b71-d042-4c99-8a80-6b68fd8d24ed admin admin] Request method failure captured: Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Accept: application/json Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Accept-Encoding: gzip, deflate Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Connection: keep-alive Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Content-Length: 0 Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Host: 10.222.0.61 Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Openstack-Api-Version: compute 2.92 Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Openstack-System-Scope: None Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: User-Agent: python-novaclient Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Auth-Token: gAAAAABjLxn5iJHEBvHYfQnoVCO01NUZ3DPDtkj_GJsL76thVswruf4YHmUmPW1X3Gqpn65JswhdlB_iqw_6qugXNQO_vzF4-e7kofwuhoj23nmlCk9p-CNtHk7EY5WKYiqqqfb9m0a7dHxTRigk1PvQLlJeNX_8MCXWIS4YnVmbsePugRIzBS8 Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Domain-Id: None Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Domain-Name: None Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Identity-Status: Confirmed Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Is-Admin-Project: True Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Domain-Id: default Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Domain-Name: Default Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Project-Name: admin Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Role: admin,reader,member Sep 24 14:53:46.150017 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Roles: admin,reader,member Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54d7e41cbbc346c5a0a397fdcad9ecdd"}]}] Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Tenant: admin Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Tenant-Id: 54d7e41cbbc346c5a0a397fdcad9ecdd Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-Tenant-Name: admin Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User: admin Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Domain-Id: default Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Domain-Name: Default Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Id: 3ea61b3146144581bb15be72dcc836fe Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: X-User-Name: admin Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: method: > Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: exception: Flavor 451 could not be found. Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: action_args: {'id': '451'} Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 14:53:46.151348 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:46.152166 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Sep 24 14:53:46.153305 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-70e29b71-d042-4c99-8a80-6b68fd8d24ed admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 14:53:46.154346 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-70e29b71-d042-4c99-8a80-6b68fd8d24ed admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011761 Sep 24 14:53:46.154346 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Sep 24 14:53:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 24 14:53:47.371884 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:47.372879 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 24 14:53:47.373277 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:47.901297 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-ee0aa8fa-5a00-4132-8d11-bbc4d593aa2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:47.920072 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-ee0aa8fa-5a00-4132-8d11-bbc4d593aa2a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.411998 Sep 24 14:53:47.920620 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Sat Sep 24 14:53:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:53:49.116234 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:49.117485 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Sep 24 14:53:49.117871 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:49.637238 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-36c90b43-967d-49ec-b9a2-33b510210cc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:49.658856 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-36c90b43-967d-49ec-b9a2-33b510210cc3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.404352 Sep 24 14:53:49.659335 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Sat Sep 24 14:53:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 14:53:50.880135 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:50.881136 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 24 14:53:50.881536 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:51.396007 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-861e9b07-2e86-4276-ab57-f117ff1d68eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:51.414881 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-861e9b07-2e86-4276-ab57-f117ff1d68eb admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.396400 Sep 24 14:53:51.415421 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Sat Sep 24 14:53:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:53:52.626581 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:52.627614 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 24 14:53:52.628007 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:53.144707 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-713d41b1-7b5a-40be-9629-0931744ebcca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:53:53.162509 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-713d41b1-7b5a-40be-9629-0931744ebcca admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399063 Sep 24 14:53:53.163053 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Sat Sep 24 14:53:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:53:54.369734 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:54.370767 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 24 14:53:54.371170 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:53:54.885525 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-c7c88150-cf85-4c2e-bb56-46e604d66c85 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:53:54.905669 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-c7c88150-cf85-4c2e-bb56-46e604d66c85 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399532 Sep 24 14:53:54.906242 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Sat Sep 24 14:53:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:54:51.106624 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:54:51.107635 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-794ed10d-5d49-43a1-8999-a8adf7f52bc0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Sep 24 14:54:51.108042 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 931 bytes} [Sat Sep 24 14:54:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:54:51.118791 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:54:51.493189 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-2e5208a5-77f1-46e7-bc0e-a5dc08326165 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:54:51.513048 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-2e5208a5-77f1-46e7-bc0e-a5dc08326165 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398994 Sep 24 14:54:51.513583 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1292 bytes} [Sat Sep 24 14:54:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:54:51.534941 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writing DB stats nova_api:SELECT=14 {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:54:51.538665 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-7d9f2cec-339d-4442-96c4-8398c54b7aaf admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:54:51.546437 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-7d9f2cec-339d-4442-96c4-8398c54b7aaf admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013071 Sep 24 14:54:51.546960 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1283 bytes} [Sat Sep 24 14:54:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:54:51.558387 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-e4f7ad6e-fd34-4121-8eb3-ba761d6028dd admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:54:51.565746 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-e4f7ad6e-fd34-4121-8eb3-ba761d6028dd admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010926 Sep 24 14:54:51.566308 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1286 bytes} [Sat Sep 24 14:54:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 14:54:51.577295 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:54:51.584318 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010473 Sep 24 14:54:51.584846 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1286 bytes} [Sat Sep 24 14:54:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:54:51.596103 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-dc1fb9ec-47fc-444b-a5bb-3a7ea124b25a admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:54:51.603075 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-dc1fb9ec-47fc-444b-a5bb-3a7ea124b25a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010324 Sep 24 14:54:51.603586 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1283 bytes} [Sat Sep 24 14:54:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 14:57:55.363234 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:57:55.364274 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001727 Sep 24 14:57:55.364673 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:57:55.505332 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:SELECT=6 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:57:55.664086 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-ad68513b-2624-47c4-9742-c7c8bcfce467 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:57:55.668761 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-ad68513b-2624-47c4-9742-c7c8bcfce467 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:57:55.669236 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-ad68513b-2624-47c4-9742-c7c8bcfce467 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:57:55.669666 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-ad68513b-2624-47c4-9742-c7c8bcfce467 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:57:55.670403 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-ad68513b-2624-47c4-9742-c7c8bcfce467 admin admin] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:57:55.670855 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-ad68513b-2624-47c4-9742-c7c8bcfce467 admin admin] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:57:55.671273 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-ad68513b-2624-47c4-9742-c7c8bcfce467 admin admin] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:57:55.702261 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-ad68513b-2624-47c4-9742-c7c8bcfce467 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.198154 Sep 24 14:57:55.702811 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Sep 24 14:57:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:57:56.763152 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:57:56.764158 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 24 14:57:56.764565 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:57:56.962456 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-c2eb1a09-b1b6-41f2-b6f0-0ed1d805674a admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:57:56.965825 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-c2eb1a09-b1b6-41f2-b6f0-0ed1d805674a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:57:56.966318 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-c2eb1a09-b1b6-41f2-b6f0-0ed1d805674a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:57:56.966743 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-c2eb1a09-b1b6-41f2-b6f0-0ed1d805674a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:57:56.967436 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-c2eb1a09-b1b6-41f2-b6f0-0ed1d805674a admin admin] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:57:56.967874 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-c2eb1a09-b1b6-41f2-b6f0-0ed1d805674a admin admin] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:57:56.968282 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-c2eb1a09-b1b6-41f2-b6f0-0ed1d805674a admin admin] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:57:56.988540 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-c2eb1a09-b1b6-41f2-b6f0-0ed1d805674a admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081509 Sep 24 14:57:56.989089 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Sep 24 14:57:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 14:58:08.462207 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:58:08.463497 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 24 14:58:08.463735 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:58:08.610750 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell0:SELECT=4 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:58:08.612052 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell1:SELECT=4 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:58:08.613122 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:SELECT=8 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:58:08.660748 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-1529d713-d9b6-4829-9c38-7723b8d0bf0d admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:58:08.664183 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-1529d713-d9b6-4829-9c38-7723b8d0bf0d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:58:08.664658 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-1529d713-d9b6-4829-9c38-7723b8d0bf0d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:58:08.665089 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-1529d713-d9b6-4829-9c38-7723b8d0bf0d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:58:08.665797 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-1529d713-d9b6-4829-9c38-7723b8d0bf0d admin admin] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:58:08.666283 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-1529d713-d9b6-4829-9c38-7723b8d0bf0d admin admin] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:58:08.666697 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-1529d713-d9b6-4829-9c38-7723b8d0bf0d admin admin] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:58:08.691958 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-1529d713-d9b6-4829-9c38-7723b8d0bf0d admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085658 Sep 24 14:58:08.692442 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Sep 24 14:58:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:58:09.774616 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG nova.api.openstack.wsgi [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] Calling method '>' {{(pid=105415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:58:09.775613 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: INFO nova.api.openstack.requestlog [None req-5a4471d6-e7a3-4ecb-a0c3-14aaa87099ab admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 24 14:58:09.776005 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: [pid: 105415|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Sat Sep 24 14:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:58:09.968577 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-93451681-edc4-4a99-bcf5-d8c863ac84b6 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:58:09.972620 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-93451681-edc4-4a99-bcf5-d8c863ac84b6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:58:09.973127 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-93451681-edc4-4a99-bcf5-d8c863ac84b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:58:09.973579 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-93451681-edc4-4a99-bcf5-d8c863ac84b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:58:09.974309 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-93451681-edc4-4a99-bcf5-d8c863ac84b6 admin admin] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:58:09.974756 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-93451681-edc4-4a99-bcf5-d8c863ac84b6 admin admin] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:58:09.975170 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-93451681-edc4-4a99-bcf5-d8c863ac84b6 admin admin] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:58:09.996476 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-93451681-edc4-4a99-bcf5-d8c863ac84b6 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.077682 Sep 24 14:58:09.996946 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Sat Sep 24 14:58:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 14:59:08.239338 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: Sat Sep 24 14:59:08 2022 - graceful shutdown triggered... Sep 24 14:59:08.239872 dv-cinder-859194-1-iscsi devstack@n-api.service[105414]: Gracefully killing worker 1 (pid: 105414)... Sep 24 14:59:08.240233 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: Gracefully killing worker 2 (pid: 105415)... Sep 24 14:59:08.241663 dv-cinder-859194-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 24 14:59:08.368819 dv-cinder-859194-1-iscsi devstack@n-api.service[105415]: DEBUG dbcounter [-] [105415] Writing DB stats nova_api:SELECT=4 {{(pid=105415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:59:09.240488 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: worker 1 buried after 1 seconds Sep 24 14:59:09.241027 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: worker 2 buried after 1 seconds Sep 24 14:59:09.241027 dv-cinder-859194-1-iscsi devstack@n-api.service[105413]: goodbye to uWSGI. Sep 24 14:59:09.242154 dv-cinder-859194-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 24 14:59:09.242712 dv-cinder-859194-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 24 14:59:09.245471 dv-cinder-859194-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 14:59:09.256476 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 14:59:09.259107 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 14:59:09 2022] *** Sep 24 14:59:09.259269 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: nodename: dv-cinder-859194-1-iscsi Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: machine: x86_64 Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: clock source: unix Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: pcre jit disabled Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: detected number of CPU cores: 4 Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: current working directory: / Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: detected binary path: /usr/bin/uwsgi-core Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: your processes number limit is 47680 Sep 24 14:59:09.259399 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: your memory page size is 4096 bytes Sep 24 14:59:09.260047 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: detected max file descriptor number: 2048 Sep 24 14:59:09.260047 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: lock engine: pthread robust mutexes Sep 24 14:59:09.260047 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: thunder lock: enabled Sep 24 14:59:09.260047 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 14:59:09.260047 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 14:59:09.301298 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: Python main interpreter initialized at 0x55fd46a119c0 Sep 24 14:59:09.301298 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: python threads support enabled Sep 24 14:59:09.301298 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: your server socket listen backlog is limited to 100 connections Sep 24 14:59:09.301298 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: your mercy for graceful operations on workers is 90 seconds Sep 24 14:59:09.301665 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 14:59:09.301746 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: *** Operational MODE: preforking *** Sep 24 14:59:09.303786 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: *** uWSGI is running in multiple interpreter mode *** Sep 24 14:59:09.303786 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: spawned uWSGI master process (pid: 120579) Sep 24 14:59:09.303362 dv-cinder-859194-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 14:59:09.304134 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: spawned uWSGI worker 1 (pid: 120590, cores: 1) Sep 24 14:59:09.304285 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: spawned uWSGI worker 2 (pid: 120591, cores: 1) Sep 24 14:59:09.304581 dv-cinder-859194-1-iscsi devstack@n-api.service[120579]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 14:59:09.979828 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 14:59:09.982581 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 14:59:11.138711 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:59:11.138711 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: from cryptography.utils import int_from_bytes Sep 24 14:59:11.139351 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:59:11.139351 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: from cryptography.utils import int_from_bytes Sep 24 14:59:11.144606 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:59:11.144606 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: from cryptography.utils import int_from_bytes Sep 24 14:59:11.145047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:59:11.145047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: from cryptography.utils import int_from_bytes Sep 24 14:59:13.578180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:59:13.578752 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:59:13.578752 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:59:13.579182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:59:13.579257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:59:13.579460 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:59:13.579723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:59:13.579897 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:59:13.580111 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.580386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:59:13.580492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.580653 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:59:13.580748 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.581059 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.581187 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.581423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.581534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.581740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.581928 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.582097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.582383 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.582492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.582727 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.582881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.582981 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.583199 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.583302 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.583539 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.583745 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859194-1-iscsi {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.583910 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.584069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.584282 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.584387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.584606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.584704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.584939 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.585094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.585295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.585583 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859194-1-iscsi {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.585744 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.586027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.586190 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.586457 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.586649 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.586819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.587191 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.587510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.590186 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.590386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.590553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.590553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.590859 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.591005 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.591146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.591296 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.591439 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.591590 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.591590 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.591881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.592041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.592184 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.592876 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859194-1-iscsi {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.593030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.593182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.593331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.593486 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.594247 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.594423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.594423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.594724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.594878 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.595040 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.595192 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.595341 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.595490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.595639 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.595788 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.595788 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.596073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.596073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.596377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.596377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.596679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859194-1-iscsi {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.596855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.597016 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.597159 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.597309 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.597464 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.597619 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.597761 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.597966 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.598132 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.598284 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.598437 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.598437 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.599247 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.599394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.599545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.599688 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.599829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.599985 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.600138 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.600281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.600458 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.600605 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.600760 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.600915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.600915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.601211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.601361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.601361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.601654 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.601805 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.601965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.602115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.602267 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.602422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.602583 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.602734 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.602876 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.603027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.603027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.603395 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.603543 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.603683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.603833 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.603982 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.604124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.604273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.604425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.604585 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.604735 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.604889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.605031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.605031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.605317 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.605469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.605613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.605613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.605896 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.605896 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.606217 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.606360 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.606517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.606517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.606803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.606951 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.607094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.607094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.607360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.607510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.607652 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.607806 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.607962 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.608115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.608115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.608115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.608575 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.608730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.608880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.609030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.609171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.609324 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.609474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.609627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.609769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.609952 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.609952 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.610258 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.610410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.610410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.610686 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.610828 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.610978 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.611119 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.611119 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.611394 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.611394 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.611672 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.611837 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.611988 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.611988 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.612264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.613179 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.613332 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.613484 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.613636 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.613785 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.613956 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.614116 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.614266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.614421 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.614421 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.614710 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.614853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.615001 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.615152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.615152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.615436 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.615578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.615719 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.615860 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.616014 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.616164 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.616313 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.616482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.616632 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.616784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.616926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.617093 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.617965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.618144 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.618144 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.618440 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.618585 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.618727 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.618876 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.619031 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.619185 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.619345 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.619490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.619641 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.619791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.619943 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.620086 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.620086 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.620362 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.620505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.620505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.620795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.620954 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.621097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.621246 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.621390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.621544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.621687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.621828 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.622003 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.622158 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.622158 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.622453 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.622602 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.622751 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.622911 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.623054 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.623195 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.623195 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.623474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.623623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.623773 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.623915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.624070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.624213 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.624213 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.624501 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.624686 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.624857 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.625008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.625151 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.625301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.625457 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.625601 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.625743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.625884 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.626103 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.626254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.626412 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.626557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.626707 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.626860 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.627001 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.627149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.627149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.627433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.627574 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.627724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.627873 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.628054 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.628737 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.628887 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.629037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.629189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.629331 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.629331 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.629616 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.629759 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.629918 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.630068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.630219 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.630376 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.630527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.630676 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.630834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.630985 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.631138 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.631289 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.631289 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.631567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.631716 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.631866 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.632017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.632246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.632246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.632519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.632519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.632802 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.632955 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.633115 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.633267 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.633411 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.633552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.633693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.633842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.634041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.634200 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.634344 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.634532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.634685 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.634872 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:59:13.635034 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.635188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.635338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.635489 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.635638 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.635805 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.635963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.636115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.636264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.636414 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.636704 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.636863 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.637020 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.637181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.637373 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.637531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.637683 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.637839 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.638013 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.638198 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.638361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.638538 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.638696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.638912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.639071 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.639215 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.639534 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.639690 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.639856 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.640019 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.640163 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.640306 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.640454 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.640596 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.640778 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.641052 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.641385 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.641536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.641746 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.641939 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.642102 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.642257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.642409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.642560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.642702 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.642892 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.643058 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.643241 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.643401 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.643613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.643793 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.643955 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.644108 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.644259 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.644411 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.644553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.644702 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.644852 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.645008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.645153 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.645344 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.645495 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.645679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.645839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.646048 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.646203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.646353 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.646499 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.646684 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.646842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.646996 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.647139 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.647312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.647463 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.647607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.647762 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.647906 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.648173 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.648333 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.648517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.648669 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.648825 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.648978 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.649128 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.649430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.649588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.649741 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.649892 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.650105 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.650274 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.650437 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.650581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.650737 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.650887 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.651070 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.651220 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.651370 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.651519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.651698 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.651859 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.652031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.652180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.652341 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.652491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.652644 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.652943 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.653098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.653250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.653393 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.653543 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.653694 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.653837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.654017 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.654170 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.654312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.654473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.654624 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.654773 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.654983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.655134 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.655312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.655476 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.655627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.655770 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.655931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.656632 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.656632 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.656980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.657139 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.657289 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.657433 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.657582 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.657738 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.657889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.658156 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.658300 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.658451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.658602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.658754 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.658754 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.659034 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.659034 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.659358 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.659516 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.659669 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.659669 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.659952 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.660093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.660244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.660394 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.660620 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.660772 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.660915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.661075 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.661229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.661372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.661526 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.661680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.661824 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.661997 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.662144 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.662299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.662448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.662597 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.662738 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.662887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.663040 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.663191 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.663416 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.663566 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.663738 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.663889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.664083 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.664243 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.664420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.664569 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.664743 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.664900 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.665075 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.665244 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.665399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.665549 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.665699 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.665849 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.666035 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.666189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.666333 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.666489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.666633 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.666775 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.666925 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.667219 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.667381 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.667526 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.667675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.668010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.668237 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.668384 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.668531 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.668787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.668921 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.669098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.669363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.669518 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.669712 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.670097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.670467 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.670643 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.670768 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.670880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.671080 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.671336 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.671493 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.671647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.671863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.672017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.672160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.672316 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.672468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.672621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.672766 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.672943 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.673144 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.673469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.673631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.673790 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.673989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.674148 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.674299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.674442 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.674605 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.674757 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.675432 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.675585 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.675811 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.675963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.676120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.676272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.676476 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.676627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.676827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.676979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.677295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.677455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.677648 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.677806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.678025 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.678195 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.678349 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.678492 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.678678 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.678837 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.679028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.679187 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.679363 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.679606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.679766 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.680011 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.680169 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.680324 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.680476 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.680690 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.680846 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.681021 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.681181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.681334 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.681476 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.681668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.681835 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.682028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.682185 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.682344 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.682488 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.682675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.682833 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.683103 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.683272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.683430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.683580 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.683723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.683879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.684040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.684193 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.684345 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.684488 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.684630 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.684772 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.684921 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.685102 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.685261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.685407 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.685557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.685731 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.685882 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.686120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.686274 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.686427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.686570 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.686720 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.686864 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.687022 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.687173 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.687454 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.687620 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.687770 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.687927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.688100 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.688379 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.688538 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.688731 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.688889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.689047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.689196 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.689384 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.689544 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.689787 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.690084 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.690257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.690441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.691172 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.691349 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.691506 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.691728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.691885 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.692041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.692193 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.692416 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.692575 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.692728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.692876 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.693033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.693207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.693477 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.693640 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.693791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.693995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.694153 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.694302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.694463 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.694620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.694771 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.694942 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.695105 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.695264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.695422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.695590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.695751 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.695910 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.696068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.696232 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.696391 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.696548 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.696707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.696867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.697025 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.697183 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.697333 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.697489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.697655 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.697655 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.697960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.698133 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.698285 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.698434 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.698589 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.698740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.698897 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.699056 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.699214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.699365 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.699523 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.700351 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.700532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.700700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.700700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.700700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.701128 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.701128 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.701427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.701755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.702063 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.702387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.702707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.702899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.703053 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.703260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.703420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.703678 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.703834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.703997 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.704155 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.704306 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.704524 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.704682 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.704840 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.705045 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.705222 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.705373 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.705521 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.705677 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.705827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.706022 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.706201 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.706366 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.706524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.706674 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.706837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.706994 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.707152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.707322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.707481 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.707631 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.707876 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.708035 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.708218 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.708377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.708534 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.708689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.708853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.709011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.709160 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.709315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.709490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.709640 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.709798 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.710084 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.710246 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.710484 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.710651 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.710811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.710962 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.711374 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.711701 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.712027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.712345 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.712674 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.712821 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.712994 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.713174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.713330 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.713534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.713658 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.713919 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.714020 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.714342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.714663 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.714916 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.715022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.715293 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.715440 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.715614 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.715894 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.716000 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.716230 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.716388 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.716549 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.716867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.716968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.717182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.717368 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.717520 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.717835 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.717973 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.718178 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.718422 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.718522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.718803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.719036 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.719146 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.719468 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.719643 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.719837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.720160 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.720317 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.720492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.720821 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.720928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.721143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.721416 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.721518 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.721791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.722071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.722193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.722455 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.722674 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.722785 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.723271 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.723390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.723479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.723710 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.723802 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.724045 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.724370 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.724483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.724692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.724966 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.725072 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.725362 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.725579 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.725692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.726021 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.726214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.726332 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.726657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.726806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.726977 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.727299 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.727392 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.727622 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.727933 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.728039 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.728282 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.728553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.728661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.728885 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.729148 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.729262 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.729519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.729772 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.729998 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.730181 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.730503 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.730614 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.730855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.731127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.731259 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.731469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.731732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.731826 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.732094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.732326 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.732446 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.732724 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.732965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.733176 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.733489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.733601 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.733814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.734153 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.734261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.734479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.734769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.734875 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.735244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.735900 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.736022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.736112 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.736196 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.736196 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.736441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.736536 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.736799 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.737057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.737155 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.738370 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.738493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.738595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.738831 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.739047 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.739167 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.739494 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.739655 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.739805 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.740122 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.740212 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.740461 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.740742 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.740835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.741092 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.741335 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.741545 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.741854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.741968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.742283 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.742510 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.742719 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.742989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.743097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.743354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.743591 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.743693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.744008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.744214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.744348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.744669 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.744800 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.745005 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.745334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.745450 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.745692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.745992 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.746090 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.746350 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.746583 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.746693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.746982 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.747177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.747330 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.747657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.747757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.747983 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.748278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.748371 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.748738 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.748840 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.749077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.749349 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.749451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.749759 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.749963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.750091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.750412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.750551 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.750729 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.751130 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.751233 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.751465 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.751679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.751792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.752008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.752254 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.752346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.752636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.752841 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.752949 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.753891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.754062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.754230 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.754550 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.754650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.754894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.755156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.755271 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.755533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.755792 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.755887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.756177 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.756383 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.756510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.756826 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.756992 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.757161 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.757482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.757572 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.757800 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.758103 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.758218 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.758448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.758699 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.758791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.759112 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.759293 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.759443 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.759787 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.759896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.760233 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.760438 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.760554 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.760784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.761055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.761154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.761458 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.761691 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.761807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.762154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.762260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.762922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.763018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.763111 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.763111 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.763406 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.763519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.763669 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.763984 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.764081 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.764485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.764598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.764696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.764919 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.765276 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.765386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.765580 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.765826 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.765968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.766207 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.766454 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.766546 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.766851 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.767055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.767170 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.767490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.767649 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.767809 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.768165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.768270 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.768481 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.768794 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.768900 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.769187 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.769415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.769512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.769804 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.769974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.770170 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.770486 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.770579 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.771169 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.771291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.771398 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.771484 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.771821 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.771929 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.772174 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.772278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.772406 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.772732 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.772870 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.773062 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.773538 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.773647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.773937 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.774038 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.774327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.774537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.774659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.774992 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.775255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.775605 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.775701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.775794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.775947 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.776074 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.776310 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.776521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.776616 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.777141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.777257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.777345 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.777516 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.777620 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.777850 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.777976 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.778221 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.778321 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.778563 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.778655 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.778894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.778993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.779241 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.779339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.779554 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.779647 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.779894 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.779984 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.780235 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.780338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.780550 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.780642 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.780876 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.780969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.781203 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.781308 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.781525 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.781617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.781854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.782093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.782213 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.782312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.782514 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.782610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.782839 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.782933 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.783155 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.783261 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.783475 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.783573 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.783801 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.783906 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.784118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.784221 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.784981 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.785076 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.785307 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.785409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.785627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.785737 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.785979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.786076 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.786310 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.786421 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.786626 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.786737 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.786950 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.787168 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.787256 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.787499 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.787600 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.787847 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.787940 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.788186 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.788330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.788525 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.788660 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.788854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.788987 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.789181 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.789309 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.789525 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.789639 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.789843 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.789961 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.790211 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.790311 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.790537 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.790648 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.790856 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.790947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.791172 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.791340 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.791505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.791670 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.791846 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.791997 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.792145 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.792325 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.792474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.792647 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.792795 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.792965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.793292 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.793392 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.793631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.793727 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.793974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.794073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.794295 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.794401 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.794615 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.794710 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.794953 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.795046 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.795273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.795374 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.795610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.795711 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.795924 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.796029 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.796242 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.796356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.796567 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.796668 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.796889 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.797096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.797202 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.797428 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.797547 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.797758 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.797872 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.798134 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.798253 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.798444 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.798533 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.798764 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.798865 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.799078 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.799213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.799417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.799530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.799861 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.800770 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.801054 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.801145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.801475 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.801700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.801782 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.802487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.802780 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.802949 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.803102 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.803254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.803410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.803644 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.803920 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.804030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.804175 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.804274 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.804274 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.804446 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.804749 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.805020 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.805118 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.805399 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.805501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.805744 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.805834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.806091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.806185 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.806432 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.806536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.806753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.806845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.807072 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.807171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.807406 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.807511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.807733 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.807831 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.808068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.808166 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.808395 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.808494 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.808721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.808818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.809057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.809150 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.809388 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.809488 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.809714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.811106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.811488 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.811580 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.811664 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.811747 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.811819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.811909 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.811994 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.812073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.812073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.812073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.812479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.812580 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.812672 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.812918 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.813027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.813109 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.813187 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.813264 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.813336 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.813457 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.813646 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.813766 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.813968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.814111 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.814253 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.814434 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.814578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.814755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.814904 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.815076 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.815266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.815403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.815615 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.815752 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.815953 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.816073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.816302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.816396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.816648 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.816747 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.816976 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.817085 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.817318 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.817418 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.817657 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.817755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.818010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.818115 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.818337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.818436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.818660 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.818750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.818989 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.819079 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.819312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.819405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.819631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.819721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.819948 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.820047 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.820265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.820363 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.820585 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.820685 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.820905 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.821010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.821271 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.821370 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.821533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.821624 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.821847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.821993 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.822190 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.822320 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.822530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.822636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.822863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.823098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.823200 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.823294 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.823496 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.823595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.823817 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.823919 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.824223 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.824349 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.824443 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.824535 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.824799 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.824901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.825119 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.825210 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.825463 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.825564 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.825788 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.825888 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.826151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.826245 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.826469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.826575 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.826787 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.826880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.827106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.827218 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.827427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.827533 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.827756 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.827848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.828077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.828168 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.828391 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.828493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.828706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.828804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.829026 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.829124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.829342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.829453 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.829657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.829748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.829995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.830322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.830527 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.830618 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.830709 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.830916 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.831015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.831252 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.831356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.831566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.831658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.831878 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.831968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.832195 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.832333 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.832510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.832624 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.832828 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.832941 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.833139 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.833282 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.833454 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.833593 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.833770 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.833931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.834184 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.834282 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.834475 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.834617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.834760 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.834901 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.835056 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.835205 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.835385 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.835522 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.835719 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.835864 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.836042 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.836180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.836376 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.836521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.836696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.836842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.837029 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.837120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.837352 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.837489 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.837678 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.837828 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.838050 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.838143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.838379 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.838480 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.838705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.838796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.839057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.839166 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.839356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.839450 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.839677 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.839782 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.839995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.840086 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.840312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.840410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.840634 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.840726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.840968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.841063 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.841281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.841385 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.841615 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.841715 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.841978 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.842073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.842311 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.842414 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.842638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.842748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.842963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.843169 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.843301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.843501 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.843609 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.843851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.843960 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.844194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.844286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.844536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.844641 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.844854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.844945 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.845179 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.845284 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.845504 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.845602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.845827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.845991 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.846174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.846276 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.846498 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.846591 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.847406 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.847516 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.847669 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.847772 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.847993 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.848092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.848317 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.848407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.848635 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.848735 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.848966 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.849058 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.849287 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.849378 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.849647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.849837 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.850015 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.850229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.850345 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.850559 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.850659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.850899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.850991 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.851209 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:59:13.851307 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.851557 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.851880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.852215 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.852534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.852854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.853177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.853501 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.853815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.854192 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.854521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.854843 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.855158 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.855480 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.855798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.856136 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.856452 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.856768 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.857084 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.857425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.857726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.858066 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.858383 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.858700 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.859025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.859341 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.859753 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.860072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.860399 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.860758 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.861082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.861420 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.861742 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.862082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.862418 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.863531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.863857 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.864193 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.864549 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.864841 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.865199 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.865529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.866107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.866456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.866790 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.867439 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.867550 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.867783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.868100 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.868418 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.868755 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.869082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.869436 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.869760 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.870111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.870433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.870756 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.871080 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.871406 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.871730 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.872051 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.872374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.872692 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.873017 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.873339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.873666 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.874055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.874388 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.874722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.875049 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.875378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.875702 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.876022 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.876344 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.876665 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.876992 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.877329 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.877653 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.877995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.878459 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.878786 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.879116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.879452 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.879772 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.880106 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.880441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.880763 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.881093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.881421 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.881761 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.882135 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.882485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.882823 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.883140 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.883459 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.883778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.884099 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.884427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.884750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.885066 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.885381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.885701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.886039 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.886357 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.886673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.886990 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.887310 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.887627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.887972 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.888253 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.888566 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.888879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.889194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.889514 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.889831 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.890174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.890494 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.890809 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.891126 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.891472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.891870 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.892154 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.892489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.892817 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.893149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.893471 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.893832 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.894197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.894527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.894878 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.895192 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.895517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.895843 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.896173 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.896497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.896819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.897144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.897485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.897825 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.898169 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.898507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.898838 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.899171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.899501 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.899827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.900169 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.900495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.900817 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.901138 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.901461 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.901791 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.902228 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.902554 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.902880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.903207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.903534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.903877 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.904214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.904535 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.904870 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.905210 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.905567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.905893 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.906280 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.906622 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.906948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.907272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.907588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:59:13.907841 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:59:13.913404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO dbcounter [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Registered counter for database nova_api Sep 24 14:59:13.935261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_db.sqlalchemy.engines [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:59:13.942231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writer thread running {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:59:13.970313 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO dbcounter [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Registered counter for database nova_api Sep 24 14:59:13.991405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_db.sqlalchemy.engines [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:59:13.998063 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writer thread running {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:59:13.998899 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.context [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15cdcebc-e767-48fd-9484-d2808c084625(cell1) {{(pid=120591) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 14:59:14.002964 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:59:14.003513 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:59:14.005118 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:59:14.005855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:59:14.006342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:59:14.008360 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:59:14.010398 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO dbcounter [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Registered counter for database nova_cell0 Sep 24 14:59:14.014458 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO dbcounter [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Registered counter for database nova_cell1 Sep 24 14:59:14.022043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_db.sqlalchemy.engines [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:59:14.024301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_db.sqlalchemy.engines [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:59:14.029791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writer thread running {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:59:14.031935 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writer thread running {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:59:14.054873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.context [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15cdcebc-e767-48fd-9484-d2808c084625(cell1) {{(pid=120590) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 14:59:14.058940 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:59:14.059433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:59:14.061029 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:59:14.061770 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 14:59:14.062332 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 14:59:14.064355 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 14:59:14.067023 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO dbcounter [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Registered counter for database nova_cell0 Sep 24 14:59:14.071087 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO dbcounter [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Registered counter for database nova_cell1 Sep 24 14:59:14.078384 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_db.sqlalchemy.engines [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:59:14.080984 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_db.sqlalchemy.engines [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:59:14.085443 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writer thread running {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:59:14.184607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO dbcounter [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Registered counter for database nova_cell0 Sep 24 14:59:14.191709 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_db.sqlalchemy.engines [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:59:14.196268 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writer thread running {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:59:14.226949 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writer thread running {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:59:14.237123 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO dbcounter [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Registered counter for database nova_cell0 Sep 24 14:59:14.246569 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_db.sqlalchemy.engines [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:59:14.250937 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writer thread running {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:59:14.517016 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: WARNING keystonemiddleware.auth_token [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:59:14.524997 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: WARNING keystonemiddleware.auth_token [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:59:14.580071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: WARNING keystonemiddleware.auth_token [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:59:14.587432 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: WARNING keystonemiddleware.auth_token [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:59:14.871077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: WARNING keystonemiddleware.auth_token [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:59:14.877158 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: WARNING keystonemiddleware.auth_token [None req-5f6ffd45-e494-4d9e-9f31-b01ac4073df1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:59:14.882550 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd46a119c0 pid: 120591 (default app) Sep 24 14:59:14.932518 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: WARNING keystonemiddleware.auth_token [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 14:59:14.938704 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: WARNING keystonemiddleware.auth_token [None req-41e560aa-f3ae-477c-aa76-4ba8f987f153 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 14:59:14.944041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd46a119c0 pid: 120590 (default app) Sep 24 14:59:50.767097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:59:50.768459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:59:50.769217 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:59:50.770460 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:59:51.312157 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:59:51.314073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:59:51.315892 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:59:51.317452 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:59:52.529947 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ff6203bb-a5e2-4314-bb32-5515f9c44736 tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Action: 'create', calling method: .version_select at 0x7f7c11b24430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1038857986", "metadata": {"Type": "work"}}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:59:52.725527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-075f7054-477b-44ef-ba70-bc54a3cad71d tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Action: 'create', calling method: .version_select at 0x7f7c11b25430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1590752549"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:59:54.793154 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-075f7054-477b-44ef-ba70-bc54a3cad71d tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.487546 Sep 24 14:59:54.794064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1155 bytes} [Sat Sep 24 14:59:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3491 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 14:59:54.811728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c285920a-6850-42fa-a177-c7fd4078875f tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c119f8310>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:54.917860 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ff6203bb-a5e2-4314-bb32-5515f9c44736 tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.163827 Sep 24 14:59:54.928758 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 1/2] 10.222.0.61 () {60 vars in 1156 bytes} [Sat Sep 24 14:59:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4167 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 14:59:54.928758 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-df206338-e7cd-4f6f-9fdb-2f658feaba46 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c119f8310>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:55.259872 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-df206338-e7cd-4f6f-9fdb-2f658feaba46 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489" status: 200 len: 346 microversion: 2.1 time: 0.339367 Sep 24 14:59:55.260646 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 14:59:54 2022] GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489 => generated 346 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:55.265567 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8bae1e20-60c9-4b8a-a739-74e23e78a26c tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c119f8a60>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:55.337191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c285920a-6850-42fa-a177-c7fd4078875f tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/ba33d1dc-9d06-4882-a7a5-6969aca20cd1" status: 200 len: 350 microversion: 2.1 time: 0.541742 Sep 24 14:59:55.346963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 14:59:54 2022] GET /compute/v2.1/os-volumes/ba33d1dc-9d06-4882-a7a5-6969aca20cd1 => generated 350 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:55.353034 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9fa825aa-5ebb-4814-93b6-e4fee2c34fff tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Action: 'create', calling method: .version_select at 0x7f7c119f89d0>, body: {"snapshot": {"volume_id": "2bd901eb-2cc2-4677-aff3-6dd193d51489", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1727652255"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 14:59:55.539321 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8bae1e20-60c9-4b8a-a739-74e23e78a26c tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 353 microversion: 2.1 time: 0.277575 Sep 24 14:59:55.540125 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 3/5] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 14:59:55 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 353 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:55.811111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9fa825aa-5ebb-4814-93b6-e4fee2c34fff tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.462851 Sep 24 14:59:55.812554 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 3/6] 10.222.0.61 () {60 vars in 1162 bytes} [Sat Sep 24 14:59:55 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:55.826130 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-55dd0c0a-3bf2-4c98-a71d-070cad87edc7 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c11994160>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:55.956797 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-55dd0c0a-3bf2-4c98-a71d-070cad87edc7 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 287 microversion: 2.1 time: 0.137301 Sep 24 14:59:55.962706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 14:59:55 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:55.976975 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1d1b852f-beb1-472d-b727-eac963a04760 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c1198eb80>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:56.070398 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1d1b852f-beb1-472d-b727-eac963a04760 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.100778 Sep 24 14:59:56.070963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1140 bytes} [Sat Sep 24 14:59:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:56.082753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cf94fc58-d5ce-491c-8cac-08de1e38ad51 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c119f8b80>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:56.250420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cf94fc58-d5ce-491c-8cac-08de1e38ad51 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 287 microversion: 2.1 time: 0.171119 Sep 24 14:59:56.251350 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 5/9] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 14:59:56 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:56.554312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b186baf5-5a4c-42c4-9111-8067ead1040e tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c11b25dc0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:56.677628 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b186baf5-5a4c-42c4-9111-8067ead1040e tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 354 microversion: 2.1 time: 0.127224 Sep 24 14:59:56.679028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 5/10] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 14:59:56 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:56.692281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e4eefbf4-0aac-440e-8938-b10de0625d9c tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c119f8430>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:56.799026 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e4eefbf4-0aac-440e-8938-b10de0625d9c tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 354 microversion: 2.1 time: 0.111203 Sep 24 14:59:56.800037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 14:59:56 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:56.819047 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a0921b60-a73f-4d2e-8824-5a4ad08a2ae2 tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c119f8940>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:56.971157 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a0921b60-a73f-4d2e-8824-5a4ad08a2ae2 tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 202 len: 0 microversion: 2.1 time: 0.156549 Sep 24 14:59:56.971605 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 14:59:56 2022] DELETE /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 14:59:56.980167 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5d0a69eb-9b1c-4d2a-b1ad-8828a7a3c98b tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c119943a0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:57.123369 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5d0a69eb-9b1c-4d2a-b1ad-8828a7a3c98b tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 353 microversion: 2.1 time: 0.147506 Sep 24 14:59:57.124519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 14:59:56 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:57.265025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-dbdf5efc-04df-419d-8e2e-856618edf625 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c119f81f0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:57.326469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-dbdf5efc-04df-419d-8e2e-856618edf625 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 287 microversion: 2.1 time: 0.066140 Sep 24 14:59:57.329424 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 7/14] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 14:59:57 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:58.141070 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c8a256a0-3bba-4963-9acc-b51aef951fdf tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c119f83a0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:58.236663 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c8a256a0-3bba-4963-9acc-b51aef951fdf tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 353 microversion: 2.1 time: 0.100390 Sep 24 14:59:58.238673 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 8/15] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 14:59:58 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:58.345187 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-440c93a1-aecd-458d-9dc0-04f8df2a8d43 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c119f89d0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:58.500698 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-440c93a1-aecd-458d-9dc0-04f8df2a8d43 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 287 microversion: 2.1 time: 0.163686 Sep 24 14:59:58.506609 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 14:59:58 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:59.264485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7e5c7565-18d0-4644-ab01-264645a8007e tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c119f8af0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:59.368643 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7e5c7565-18d0-4644-ab01-264645a8007e tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 353 microversion: 2.1 time: 0.108186 Sep 24 14:59:59.370065 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 9/17] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 14:59:59 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 14:59:59.514210 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-eeae4513-20e0-4cd0-8d94-1e3cac353e25 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c123518b0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 14:59:59.599907 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-eeae4513-20e0-4cd0-8d94-1e3cac353e25 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 287 microversion: 2.1 time: 0.089780 Sep 24 14:59:59.601552 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 9/18] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 14:59:59 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:00.384338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f003c945-8440-44fa-a602-3d3261eebb7c tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c1198e550>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:00.425819 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4613583f-0b83-456b-8d96-3b398c9783fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: .version_select at 0x7f7c11994670>, body: {"keypair": {"name": "tempest-keypair-1375814724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk8rpS0Udpg6axahpEUFdzrzMv/PHUc3p8mzIN/SQ0I/V8Xfz57yPOYVniEUszFdp8TTcxJXQp8DKeSR4jdU1qCWY1R89hT2EEPldLyH4ZcptEXQe2tnvMTbV96dWl4zg=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:00.501379 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f003c945-8440-44fa-a602-3d3261eebb7c tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 353 microversion: 2.1 time: 0.121161 Sep 24 15:00:00.502228 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 10/19] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:00 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:00:00.527682 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-4613583f-0b83-456b-8d96-3b398c9783fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:00:00.537198 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-4613583f-0b83-456b-8d96-3b398c9783fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for user 9f74f51060554db18bc96199222e9261 and project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:00:00.613601 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f10bc4b2-1b6d-4f39-95d1-7c10c55e8f22 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c1198ea60>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:00.615062 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4613583f-0b83-456b-8d96-3b398c9783fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.287727 Sep 24 15:00:00.625006 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 10/20] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:00:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:00.666002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f10bc4b2-1b6d-4f39-95d1-7c10c55e8f22 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 287 microversion: 2.1 time: 0.056959 Sep 24 15:00:00.666596 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 11/21] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 15:00:00 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:00:01.522957 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f2b64855-090c-4f95-ba37-7ea746b2426b tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c11976820>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:01.608267 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f2b64855-090c-4f95-ba37-7ea746b2426b tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 353 microversion: 2.1 time: 0.092453 Sep 24 15:00:01.609254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 11/22] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:01 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:01.679221 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-db6c0799-e1d9-47b8-b637-c02f3d2a8309 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c119f8430>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:01.774057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-db6c0799-e1d9-47b8-b637-c02f3d2a8309 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 288 microversion: 2.1 time: 0.098621 Sep 24 15:00:01.782848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 12/23] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 15:00:01 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 288 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:01.787825 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1aadb046-94a8-47d6-9fca-17ed6ff97399 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c11976ee0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:01.964106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1aadb046-94a8-47d6-9fca-17ed6ff97399 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 202 len: 0 microversion: 2.1 time: 0.180142 Sep 24 15:00:01.964985 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 12/24] 10.222.0.61 () {58 vars in 1254 bytes} [Sat Sep 24 15:00:01 2022] DELETE /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:00:01.975906 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9b34ef8b-351a-4063-8a4f-d0c12c55906a tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c119f89d0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:02.030041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9b34ef8b-351a-4063-8a4f-d0c12c55906a tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 287 microversion: 2.1 time: 0.060048 Sep 24 15:00:02.036123 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 13/25] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 15:00:01 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:02.608272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-359adaa7-b79b-4a74-8809-08f45c20b829 tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c1191f670>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:02.623757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-927ea1d8-7984-4626-ac8c-e89451cb7b5f tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c1198e8b0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:02.714295 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-927ea1d8-7984-4626-ac8c-e89451cb7b5f tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 353 microversion: 2.1 time: 0.094135 Sep 24 15:00:02.714951 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 14/26] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:02 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:00:02.718675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-359adaa7-b79b-4a74-8809-08f45c20b829 tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/499bc776-761e-4298-97a4-d4ec16464b4b" status: 200 len: 351 microversion: 2.1 time: 0.114647 Sep 24 15:00:02.719699 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 13/27] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:02 2022] GET /compute/v2.1/os-volumes/499bc776-761e-4298-97a4-d4ec16464b4b => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:03.043524 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d664eba9-1290-471b-9b23-7ce63cf58dde tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c1198e4c0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:03.100381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d664eba9-1290-471b-9b23-7ce63cf58dde tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 287 microversion: 2.1 time: 0.060780 Sep 24 15:00:03.101327 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 15/28] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 15:00:03 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:03.740163 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-108abdc0-e392-4007-8117-0ef1a78c4f4f tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c11976c10>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:03.841939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-108abdc0-e392-4007-8117-0ef1a78c4f4f tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 353 microversion: 2.1 time: 0.105752 Sep 24 15:00:03.842563 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 14/29] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:03 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:00:04.098264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2cb748b8-6ce7-49cd-9322-7f0e44cac869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'create', calling method: .version_select at 0x7f7c1198e1f0>, body: {"keypair": {"name": "tempest-keypair-1598955397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE89IZ3ED/z6O49K+9EGSwNUtr63F3YUD/Cd9+ZG7uD2EQhJo/IUJPy4hCmbY9SBG3t3achxTZo1lNvxMJwTuVPFw9gRPJ6UdpTuew+4rSLnKOU3r55lZYw3BmUZT1QPw=="}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:04.115518 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-22add95a-0184-4c88-bca5-9078d8a23d18 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c11976280>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:04.185527 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-22add95a-0184-4c88-bca5-9078d8a23d18 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 200 len: 287 microversion: 2.1 time: 0.075127 Sep 24 15:00:04.186505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 15/30] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 15:00:04 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:04.203458 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-2cb748b8-6ce7-49cd-9322-7f0e44cac869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Getting quotas for project ea560f6e50034738b03e588ada15e940. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:00:04.213886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-2cb748b8-6ce7-49cd-9322-7f0e44cac869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Getting quotas for user cdbc898ffd4f4d5d87c3684fcc17313d and project ea560f6e50034738b03e588ada15e940. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:00:04.337523 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2cb748b8-6ce7-49cd-9322-7f0e44cac869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.352069 Sep 24 15:00:04.340368 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 16/31] 10.222.0.61 () {62 vars in 1200 bytes} [Sat Sep 24 15:00:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 359 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 15:00:04.857397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f71ec7ae-0ae4-431f-99f5-0849507380de tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c1191f5e0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:04.945268 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f71ec7ae-0ae4-431f-99f5-0849507380de tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 200 len: 353 microversion: 2.1 time: 0.092844 Sep 24 15:00:04.946639 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 16/32] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:04 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:05.198776 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-536ebc75-2249-4dc3-b3a6-52bb4597a922 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c11979b80>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:05.287391 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-536ebc75-2249-4dc3-b3a6-52bb4597a922 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] HTTP exception thrown: Snapshot 328f256a-7f25-4275-af57-fa1019a5a89b could not be found. Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-536ebc75-2249-4dc3-b3a6-52bb4597a922 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Request method failure captured: Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b HTTP/1.1 Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtne7WwLw9cGhtDufXb09zINxzSpzPnnAVsSpbTiyrSMxMksW8o94DlASDVMjTLJVrU0VU7My5ohKxElGSKB91oLKfkcCcI6Rk0kunwqGygF72h2B-zQQ5QtVEQQWQCytdcv1UaGSl4MjRQguYFjPYM2QxFVjXYsZpE_VDHPXSoQxQ Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 727eb826972a49cf87453855388045f6 Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:00:05.296456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_727eb826972a49cf87453855388045f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/727eb826972a49cf87453855388045f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/727eb826972a49cf87453855388045f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/727eb826972a49cf87453855388045f6"}]}] Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 727eb826972a49cf87453855388045f6 Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesSnapshotsTestJSON-1440625497-project Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 3f880497e66e4a94bb2b81ef5fdc4a72 Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1440625497-project Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Snapshot 328f256a-7f25-4275-af57-fa1019a5a89b could not be found. Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '328f256a-7f25-4275-af57-fa1019a5a89b'} Sep 24 15:00:05.297578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 328f256a-7f25-4275-af57-fa1019a5a89b could not be found. (HTTP 404) (Request-ID: req-55abf17f-aee4-413d-b301-c280561197b8) Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:05.299098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:00:05.299958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 328f256a-7f25-4275-af57-fa1019a5a89b could not be found. Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 24 15:00:05.301469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 328f256a-7f25-4275-af57-fa1019a5a89b could not be found. Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 328f256a-7f25-4275-af57-fa1019a5a89b could not be found. Sep 24 15:00:05.303530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:05.308111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-536ebc75-2249-4dc3-b3a6-52bb4597a922 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Returning 404 to user: Snapshot 328f256a-7f25-4275-af57-fa1019a5a89b could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:00:05.308111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-536ebc75-2249-4dc3-b3a6-52bb4597a922 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b" status: 404 len: 111 microversion: 2.1 time: 0.112859 Sep 24 15:00:05.308111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 17/33] 10.222.0.61 () {58 vars in 1251 bytes} [Sat Sep 24 15:00:05 2022] GET /compute/v2.1/os-snapshots/328f256a-7f25-4275-af57-fa1019a5a89b => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:00:05.323312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b1e0985c-9eb8-45f0-841f-010bd919fe22 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c119070d0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:05.404725 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1638392586", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "networks": [{"uuid": "2bd8bb1c-1840-49fb-b3ed-b82e395cb56b"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:05.508769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b1e0985c-9eb8-45f0-841f-010bd919fe22 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489" status: 202 len: 0 microversion: 2.1 time: 0.192716 Sep 24 15:00:05.512310 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 18/34] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 15:00:05 2022] DELETE /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:00:05.532314 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b0aa0696-26d8-4145-af32-6a9875ae5d34 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c12351820>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:05.635639 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b0aa0696-26d8-4145-af32-6a9875ae5d34 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489" status: 200 len: 345 microversion: 2.1 time: 0.116562 Sep 24 15:00:05.636497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 19/35] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:05 2022] GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:05.649252 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] validate_networks() for [('2bd8bb1c-1840-49fb-b3ed-b82e395cb56b', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:00:05.653084 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a50db822-b162-47e1-a3fa-cfbdec7af5fe tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c11907280>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:05.799438 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a50db822-b162-47e1-a3fa-cfbdec7af5fe tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/16a79e9b-3e4b-41b4-bf34-b4bbc934c2fd" status: 200 len: 350 microversion: 2.1 time: 0.161172 Sep 24 15:00:05.800560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 20/36] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:05 2022] GET /compute/v2.1/os-volumes/16a79e9b-3e4b-41b4-bf34-b4bbc934c2fd => generated 350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:05.814467 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-270d6f1d-24d8-41fc-b55d-f42dc3c2aa3b tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c119078b0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:06.057078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-270d6f1d-24d8-41fc-b55d-f42dc3c2aa3b tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.246885 Sep 24 15:00:06.057774 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 21/37] 10.222.0.61 () {58 vars in 1134 bytes} [Sat Sep 24 15:00:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:06.062529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fc48f491-0b98-4de8-9d50-acd847b5ba78 tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Calling method '.version_select at 0x7f7c11907940>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:06.105262 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-fc48f491-0b98-4de8-9d50-acd847b5ba78 tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] HTTP exception thrown: Volume b5d92d8f-d674-4556-9dcd-d912d8d31094 could not be found. Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fc48f491-0b98-4de8-9d50-acd847b5ba78 tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Request method failure captured: Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 HTTP/1.1 Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtm-IjEzfgHLpmpRUiMb4xCVbQ_mPShdt7I9F59MNTKAJtmfu5P63sJb0xWGYbiDcSqo4-Lu9H11sU6x7XYPOYzZ7JHkvVszoJeKh9kJJ4rH5zNVpfSSST_8HPZr2MBNj-GXEUCen-ozmNsjnl47O_ePm169tAXao5xPtjM1uiwKa8 Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: c2e445f0acdd4718a39a8aef7043802b Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesGetTestJSON-571236569 Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:00:06.107931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c2e445f0acdd4718a39a8aef7043802b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c2e445f0acdd4718a39a8aef7043802b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c2e445f0acdd4718a39a8aef7043802b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c2e445f0acdd4718a39a8aef7043802b"}]}] Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesGetTestJSON-571236569 Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: c2e445f0acdd4718a39a8aef7043802b Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesGetTestJSON-571236569 Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesGetTestJSON-571236569-project Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: cbc9c7ef2b4345e6bc3ec01935dc697b Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesGetTestJSON-571236569-project Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Volume b5d92d8f-d674-4556-9dcd-d912d8d31094 could not be found. Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'b5d92d8f-d674-4556-9dcd-d912d8d31094'} Sep 24 15:00:06.109174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5d92d8f-d674-4556-9dcd-d912d8d31094 could not be found. (HTTP 404) (Request-ID: req-1c4a874d-053e-47c6-afd6-a8ee1e5ac971) Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:06.110070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:00:06.111156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5d92d8f-d674-4556-9dcd-d912d8d31094 could not be found. Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 15:00:06.112207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5d92d8f-d674-4556-9dcd-d912d8d31094 could not be found. Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5d92d8f-d674-4556-9dcd-d912d8d31094 could not be found. Sep 24 15:00:06.113724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:06.115356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fc48f491-0b98-4de8-9d50-acd847b5ba78 tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] Returning 404 to user: Volume b5d92d8f-d674-4556-9dcd-d912d8d31094 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:00:06.116359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fc48f491-0b98-4de8-9d50-acd847b5ba78 tempest-VolumesGetTestJSON-571236569 tempest-VolumesGetTestJSON-571236569-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094" status: 404 len: 109 microversion: 2.1 time: 0.057509 Sep 24 15:00:06.116925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 22/38] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:06 2022] GET /compute/v2.1/os-volumes/b5d92d8f-d674-4556-9dcd-d912d8d31094 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:00:06.199027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1276485947", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:06.379787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] validate_networks() for [('cfe3ea10-cfdc-43fc-b917-03b5fac0d633', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:00:07.551930 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:00:07.553074 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:00:07.553890 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:00:07.555827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:00:07.556651 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:00:07.583436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:07.588760 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:07.592357 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:07.594704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:07.595725 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:07.596181 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:07.647590 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Getting quotas for project 5a28fd8d62a54976b961c31176fed822. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:00:07.653012 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Getting quotas for user 5b63ee5b9ac44eb39617b291ac869db7 and project 5a28fd8d62a54976b961c31176fed822. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:00:07.666629 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:00:07.667429 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:00:07.668008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:00:07.668434 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:00:07.668983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:00:07.679296 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:00:07.682957 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:00:07.715211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:07.715717 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:07.716167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:07.716900 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:07.722765 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:07.723300 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:07.778370 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Getting quotas for project 578268f34d874bf9835e8ec4cb31ebee. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:00:07.786062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Getting quotas for user db5a0bddb68047d68f0c2dd1af0cd57b and project 578268f34d874bf9835e8ec4cb31ebee. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:00:07.800797 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:00:07.805240 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:00:07.816928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-593d2913-641f-4e2f-b89c-84356a6497e4 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.516850 Sep 24 15:00:07.832296 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 17/39] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:00:07.843988 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1034808138", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a01210a-747c-4b32-8123-27378a645fb5"}], "security_groups": [{"name": "tempest-securitygroup--1293508509"}], "key_name": "tempest-keypair-1375814724", "user_data": "}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:07.958618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-dda39181-045a-4173-821e-f8f401f46ba9 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.835100 Sep 24 15:00:07.967646 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 23/40] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:00:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:00:08.003033 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-dc50e55b-13b2-4635-adaa-bcfacd28b65a tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c1181fca0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:08.236442 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] validate_networks() for [('8a01210a-747c-4b32-8123-27378a645fb5', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:00:08.237531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-dc50e55b-13b2-4635-adaa-bcfacd28b65a tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.268379 Sep 24 15:00:08.238775 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 24/41] 10.222.0.61 () {58 vars in 1149 bytes} [Sat Sep 24 15:00:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:08.253881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1bb78959-690b-4fb5-a6a2-3943a05863e0 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c1183e0d0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:08.318483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-1bb78959-690b-4fb5-a6a2-3943a05863e0 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] HTTP exception thrown: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1bb78959-690b-4fb5-a6a2-3943a05863e0 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Request method failure captured: Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489 HTTP/1.1 Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtne7WwLw9cGhtDufXb09zINxzSpzPnnAVsSpbTiyrSMxMksW8o94DlASDVMjTLJVrU0VU7My5ohKxElGSKB91oLKfkcCcI6Rk0kunwqGygF72h2B-zQQ5QtVEQQWQCytdcv1UaGSl4MjRQguYFjPYM2QxFVjXYsZpE_VDHPXSoQxQ Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 727eb826972a49cf87453855388045f6 Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:00:08.323315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_727eb826972a49cf87453855388045f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/727eb826972a49cf87453855388045f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/727eb826972a49cf87453855388045f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/727eb826972a49cf87453855388045f6"}]}] Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 727eb826972a49cf87453855388045f6 Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesSnapshotsTestJSON-1440625497-project Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 3f880497e66e4a94bb2b81ef5fdc4a72 Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1440625497-project Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '2bd901eb-2cc2-4677-aff3-6dd193d51489'} Sep 24 15:00:08.324610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. (HTTP 404) (Request-ID: req-ec464a6a-e34d-4d59-acbf-a4b5127940f6) Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:08.325415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:00:08.326574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 15:00:08.327701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:08.328808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:08.331548 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1bb78959-690b-4fb5-a6a2-3943a05863e0 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Returning 404 to user: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:00:08.332412 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1bb78959-690b-4fb5-a6a2-3943a05863e0 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489" status: 404 len: 109 microversion: 2.1 time: 0.082557 Sep 24 15:00:08.333187 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 25/42] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:08 2022] GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:00:08.353132 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-be65d106-867f-4295-93ce-29befd7f5a73 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:08.355258 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-be65d106-867f-4295-93ce-29befd7f5a73 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:08.834366 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-be65d106-867f-4295-93ce-29befd7f5a73 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:08.856790 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-be65d106-867f-4295-93ce-29befd7f5a73 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1215 microversion: 2.1 time: 0.510311 Sep 24 15:00:08.862642 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 26/43] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:08 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1215 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:08.870129 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9b8196a3-7711-432e-b4e1-9bb0a53e1359 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:08.870873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9b8196a3-7711-432e-b4e1-9bb0a53e1359 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:08.952254 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9b8196a3-7711-432e-b4e1-9bb0a53e1359 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:08.962644 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9b8196a3-7711-432e-b4e1-9bb0a53e1359 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1222 microversion: 2.1 time: 0.097646 Sep 24 15:00:08.964938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:00:08.965555 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 27/44] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:08 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:08.965658 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:00:08.965812 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:00:08.966665 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:00:08.967084 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:00:08.971394 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-448b7210-38ad-4ecf-bca8-f34a3c3a599d tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c10fdd5e0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:08.991782 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:08.992512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:08.993562 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:08.995853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:08.997251 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:08.998228 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:09.045104 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:00:09.062810 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for user 9f74f51060554db18bc96199222e9261 and project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:00:09.102844 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:00:09.109143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:00:09.200858 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-448b7210-38ad-4ecf-bca8-f34a3c3a599d tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.233548 Sep 24 15:00:09.212264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 28/45] 10.222.0.61 () {58 vars in 1134 bytes} [Sat Sep 24 15:00:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:09.222337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3e45f370-78f5-46c2-83ed-7d73a5c95ca1 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c10fe3790>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:09.251051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-45c776e2-683d-4998-bc24-57cdc9631a17 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.416102 Sep 24 15:00:09.259786 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 18/46] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:00:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-3e45f370-78f5-46c2-83ed-7d73a5c95ca1 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] HTTP exception thrown: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3e45f370-78f5-46c2-83ed-7d73a5c95ca1 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Request method failure captured: Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: DELETE /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489 HTTP/1.1 Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtne7WwLw9cGhtDufXb09zINxzSpzPnnAVsSpbTiyrSMxMksW8o94DlASDVMjTLJVrU0VU7My5ohKxElGSKB91oLKfkcCcI6Rk0kunwqGygF72h2B-zQQ5QtVEQQWQCytdcv1UaGSl4MjRQguYFjPYM2QxFVjXYsZpE_VDHPXSoQxQ Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 727eb826972a49cf87453855388045f6 Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:00:09.259960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_727eb826972a49cf87453855388045f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/727eb826972a49cf87453855388045f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/727eb826972a49cf87453855388045f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/727eb826972a49cf87453855388045f6"}]}] Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 727eb826972a49cf87453855388045f6 Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesSnapshotsTestJSON-1440625497-project Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 3f880497e66e4a94bb2b81ef5fdc4a72 Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1440625497-project Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '2bd901eb-2cc2-4677-aff3-6dd193d51489'} Sep 24 15:00:09.261255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. (HTTP 404) (Request-ID: req-6f97fffa-4ec4-4434-91fe-b6495500b17e) Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:09.262000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 15:00:09.263164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 15:00:09.264338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:00:09.265545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3e45f370-78f5-46c2-83ed-7d73a5c95ca1 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Returning 404 to user: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:00:09.266515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3e45f370-78f5-46c2-83ed-7d73a5c95ca1 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489" status: 404 len: 109 microversion: 2.1 time: 0.046247 Sep 24 15:00:09.267968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 29/47] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 15:00:09 2022] DELETE /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:00:09.274224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-237447706", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:09.274379 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1313769559", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "584d4e28-f5e4-4c8e-b2b6-d79b1d6a84f9"}], "security_groups": [{"name": "tempest-securitygroup--1116533355"}], "key_name": "tempest-keypair-1598955397", "user_data": "}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:09.467496 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] validate_networks() for [('cfe3ea10-cfdc-43fc-b917-03b5fac0d633', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:00:09.602721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] validate_networks() for [('584d4e28-f5e4-4c8e-b2b6-d79b1d6a84f9', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:00:10.227534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:00:10.228157 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:00:10.231631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:00:10.232571 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:00:10.233323 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:00:10.247776 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:10.248710 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:10.249316 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:10.259007 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:10.259784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:10.260241 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:10.304274 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Getting quotas for project 578268f34d874bf9835e8ec4cb31ebee. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:00:10.313656 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Getting quotas for user db5a0bddb68047d68f0c2dd1af0cd57b and project 578268f34d874bf9835e8ec4cb31ebee. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:00:10.335407 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:00:10.338532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:00:10.420739 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-12b413ba-418a-4300-8334-da9dd19d7159 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.150519 Sep 24 15:00:10.422046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 30/48] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:00:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:00:10.437134 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1deb546c-e63c-47c6-866d-e87c224b4f4b tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c10fdda60>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:10.624614 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:00:10.626820 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:00:10.627522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:00:10.628780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:00:10.629304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:00:10.633038 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1deb546c-e63c-47c6-866d-e87c224b4f4b tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203616 Sep 24 15:00:10.634036 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 31/49] 10.222.0.61 () {58 vars in 1167 bytes} [Sat Sep 24 15:00:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:10.641121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:10.642693 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:10.650427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:10.651158 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:10.651699 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:10.653402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:10.656518 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:10.657055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:10.658501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:10.659120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:10.659234 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:10.660178 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:10.661977 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:10.662432 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:10.712513 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Getting quotas for project ea560f6e50034738b03e588ada15e940. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:00:10.738673 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Getting quotas for user cdbc898ffd4f4d5d87c3684fcc17313d and project ea560f6e50034738b03e588ada15e940. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:00:10.773281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:00:10.775658 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:00:10.900412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-64c89ce6-c7cc-44ca-9462-b0bee4caa757 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.643814 Sep 24 15:00:10.908334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 19/50] 10.222.0.61 () {62 vars in 1188 bytes} [Sat Sep 24 15:00:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 15:00:10.938628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bec344f7-5ab4-48d3-bedf-76fc44b13ea8 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Calling method '.version_select at 0x7f7c110604c0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:11.038204 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-bec344f7-5ab4-48d3-bedf-76fc44b13ea8 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] HTTP exception thrown: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bec344f7-5ab4-48d3-bedf-76fc44b13ea8 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Request method failure captured: Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489 HTTP/1.1 Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxtne7WwLw9cGhtDufXb09zINxzSpzPnnAVsSpbTiyrSMxMksW8o94DlASDVMjTLJVrU0VU7My5ohKxElGSKB91oLKfkcCcI6Rk0kunwqGygF72h2B-zQQ5QtVEQQWQCytdcv1UaGSl4MjRQguYFjPYM2QxFVjXYsZpE_VDHPXSoQxQ Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 727eb826972a49cf87453855388045f6 Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:00:11.043971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_727eb826972a49cf87453855388045f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/727eb826972a49cf87453855388045f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/727eb826972a49cf87453855388045f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/727eb826972a49cf87453855388045f6"}]}] Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 727eb826972a49cf87453855388045f6 Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1440625497 Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-VolumesSnapshotsTestJSON-1440625497-project Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 3f880497e66e4a94bb2b81ef5fdc4a72 Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1440625497-project Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '2bd901eb-2cc2-4677-aff3-6dd193d51489'} Sep 24 15:00:11.045323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. (HTTP 404) (Request-ID: req-cb43eed8-5b48-4147-83e8-de464b6b0916) Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:11.046051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:00:11.047031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 15:00:11.049607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bec344f7-5ab4-48d3-bedf-76fc44b13ea8 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] Returning 404 to user: Volume 2bd901eb-2cc2-4677-aff3-6dd193d51489 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bec344f7-5ab4-48d3-bedf-76fc44b13ea8 tempest-VolumesSnapshotsTestJSON-1440625497 tempest-VolumesSnapshotsTestJSON-1440625497-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489" status: 404 len: 109 microversion: 2.1 time: 0.136101 Sep 24 15:00:11.051604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 20/51] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:00:10 2022] GET /compute/v2.1/os-volumes/2bd901eb-2cc2-4677-aff3-6dd193d51489 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:00:11.060832 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:11.081702 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c35a721b-56e0-453e-95af-f71b0d010c44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1246 microversion: 2.1 time: 0.446179 Sep 24 15:00:11.084384 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 32/52] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:10 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1246 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:11.091889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c6a9ff3a-9da5-4efd-8a56-c50480cea072 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:11.092042 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:11.092610 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:11.093483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c6a9ff3a-9da5-4efd-8a56-c50480cea072 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:11.153883 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:11.155417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:11.160415 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:11.166275 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:11.167037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:11.167653 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:11.197570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c6a9ff3a-9da5-4efd-8a56-c50480cea072 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:11.215854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c6a9ff3a-9da5-4efd-8a56-c50480cea072 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1221 microversion: 2.1 time: 0.128982 Sep 24 15:00:11.231714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 33/53] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:11 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:11.244516 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b7a8a1a6-a781-4095-bb3f-f79a62142a91 tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c10f50670>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:11.554519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b7a8a1a6-a781-4095-bb3f-f79a62142a91 tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.321776 Sep 24 15:00:11.555093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 34/54] 10.222.0.61 () {58 vars in 1170 bytes} [Sat Sep 24 15:00:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:11.582581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0118ad86-5659-40e1-96f3-1337cb292e49 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:11.584664 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0118ad86-5659-40e1-96f3-1337cb292e49 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:11.678867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:11.698492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e16d57b1-15ec-4c60-b1f8-08a9fb1a93db tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1211 microversion: 2.1 time: 0.635975 Sep 24 15:00:11.699208 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 21/55] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:11 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1211 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:11.704068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9eeab68d-4bfe-4512-92b6-8803592b22c2 tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c10fb8f70>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:11.784160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0118ad86-5659-40e1-96f3-1337cb292e49 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:11.823227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0118ad86-5659-40e1-96f3-1337cb292e49 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:11.825788 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0118ad86-5659-40e1-96f3-1337cb292e49 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:11.827532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0118ad86-5659-40e1-96f3-1337cb292e49 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1282 microversion: 2.20 time: 0.260996 Sep 24 15:00:11.832675 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 35/56] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:11 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1282 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:11.848285 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9eeab68d-4bfe-4512-92b6-8803592b22c2 tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.147676 Sep 24 15:00:11.850808 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 22/57] 10.222.0.61 () {58 vars in 1155 bytes} [Sat Sep 24 15:00:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:11.875696 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-28b70bcb-edbc-47cd-abe6-43f23297256d tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c10f5daf0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:12.109314 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:12.109995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:12.130383 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:12.131742 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:12.134174 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:12.136354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:12.139600 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-28b70bcb-edbc-47cd-abe6-43f23297256d tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.278632 Sep 24 15:00:12.140705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 36/58] 10.222.0.61 () {58 vars in 1188 bytes} [Sat Sep 24 15:00:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:12.154061 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5b8ff292-aea0-4ef1-a59b-6ccd74bb08a7 tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] Calling method '.version_select at 0x7f7c10f50ee0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:12.159936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:12.163093 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:12.376531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5b8ff292-aea0-4ef1-a59b-6ccd74bb08a7 tempest-VolumesTestJSON-5642481 tempest-VolumesTestJSON-5642481-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.226217 Sep 24 15:00:12.377110 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 37/59] 10.222.0.61 () {58 vars in 1155 bytes} [Sat Sep 24 15:00:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:12.382087 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:12.382711 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:12.399749 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:12.401240 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:12.404152 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:12.404934 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:12.405420 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:12.408565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:12.563549 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:12.598812 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9889e99e-3e73-4985-9cd0-56eaebe332d8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1238 microversion: 2.1 time: 0.491923 Sep 24 15:00:12.623807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 23/60] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:12 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1238 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:12.728199 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:12.730438 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:12.769863 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:12.770397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:12.777239 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:12.779257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:12.781601 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:12.782985 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:12.964858 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:12.975923 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-13c454c4-51fc-4e74-8494-a6d97f5e77bf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1217 microversion: 2.1 time: 0.597289 Sep 24 15:00:12.976806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 38/61] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:12 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1217 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:12.987271 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:12.990695 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:13.022442 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:13.022949 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:13.023393 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:13.036684 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:13.037839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:13.055546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:13.055546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:13.055782 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3107ad02-8e83-4fea-8f89-832d74b0a0dc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1267 microversion: 2.1 time: 0.329222 Sep 24 15:00:13.064333 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 24/62] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:12 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:13.150283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:13.162931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:13.175718 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:13.177180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-148628fa-e84a-435e-947b-32ccb458bf06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1278 microversion: 2.20 time: 0.194635 Sep 24 15:00:13.177923 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 39/63] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:12 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:13.630665 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:13.636109 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:13.658889 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:13.661025 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:13.661716 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:13.665890 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:13.669233 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:13.670420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:14.006137 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:14.006772 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:14.016413 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:14.016964 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:14.017399 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:14.019001 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:14.019482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:14.019933 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:14.326415 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:14.347837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-78234180-89da-4032-93b4-911d9ae4ff6c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1294 microversion: 2.1 time: 0.720961 Sep 24 15:00:14.350941 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 25/64] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:13 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1294 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:14.373853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:14.380432 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:14.405026 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:14.405394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:14.405850 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:14.406598 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:14.407067 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:14.407507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:14.550222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:14.565010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-30f2fc36-cf50-449c-a4f6-39355e41a7b4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1217 microversion: 2.1 time: 0.564175 Sep 24 15:00:14.588342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 40/65] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:13 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1217 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:14.608987 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:14.610401 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:14.646616 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:14.647473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:14.648142 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:14.649217 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:14.649890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:14.651644 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:14.746533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:14.757629 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8d01bd1f-c9c2-4738-aeda-e2e335d27f1a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1273 microversion: 2.1 time: 0.405388 Sep 24 15:00:14.768535 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 26/66] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:14 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1273 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:15.326680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:15.340193 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:15.346039 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:15.347663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ea9172b2-e592-4561-96a1-bb514f42ee06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1278 microversion: 2.20 time: 0.753777 Sep 24 15:00:15.348546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 41/67] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:14 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1278 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:15.373278 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:15.374257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:15.384341 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:15.384819 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:15.385281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:15.386025 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:15.386495 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:15.386930 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:15.521275 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:15.534589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-809a47f1-0f8e-4554-8eb0-ea11ae044254 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1302 microversion: 2.1 time: 0.167339 Sep 24 15:00:15.535661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 27/68] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:15 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1302 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:15.599151 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:15.600046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:15.606497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:15.607246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:15.607846 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:15.608726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:15.609328 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:15.609918 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:15.686155 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:15.695885 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-32be68c9-1cef-469b-986f-490b02c194cc tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1273 microversion: 2.1 time: 0.100495 Sep 24 15:00:15.696386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 42/69] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:15 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:15.795968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:15.796523 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:15.813494 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:15.814858 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:15.815259 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:15.815836 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:15.816461 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:15.817049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:15.929847 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:15.941561 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9da39263-1473-4ced-be15-74fcdf6d36e8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1273 microversion: 2.1 time: 0.149467 Sep 24 15:00:15.955165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 28/70] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:15 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:16.377630 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:16.378886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:16.396062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:16.396597 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:16.399025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:16.399885 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:16.400371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:16.400820 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:16.560748 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:16.562068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:16.573211 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:16.574506 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:16.575279 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:16.576474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:16.577277 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:16.578098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:16.668851 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:16.684651 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4d6268af-53c9-426b-8103-cc82390247fc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1312 microversion: 2.1 time: 0.127397 Sep 24 15:00:16.690310 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 29/71] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:16 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:16.709663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:16.717975 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:16.719429 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:16.719611 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:16.720426 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:16.720572 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d6fbffcc-c009-49ca-8595-75549844bfe0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1278 microversion: 2.20 time: 0.348292 Sep 24 15:00:16.730170 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 43/72] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:16 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1278 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:16.757354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:16.763145 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:16.764521 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:16.765454 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:16.765948 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:16.766377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:16.886585 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:16.896321 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-941bfcd6-b558-4c05-943a-f835a0b6f928 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1273 microversion: 2.1 time: 0.181489 Sep 24 15:00:16.896904 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 30/73] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:16 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:16.965634 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:16.966525 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:16.974775 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:16.975283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:16.975732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:16.978047 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:16.978905 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:16.979358 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:17.183243 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:17.193148 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-59544a1c-59d0-4ffd-ab2e-256bbbf5aba3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.232338 Sep 24 15:00:17.194955 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 44/74] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:16 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:17.711500 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:17.712897 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:17.726763 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:17.727760 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:17.728493 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:17.733857 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:17.734638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:17.735512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:17.757707 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:17.759514 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:17.783136 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:17.783697 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:17.784204 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:17.785102 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:17.787692 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:17.795996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:17.875471 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:17.888414 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2e62cc12-df64-4316-abda-fca7170c3a5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1312 microversion: 2.1 time: 0.181751 Sep 24 15:00:17.889679 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 31/75] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:17 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:17.921020 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:17.921956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:17.944419 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:17.945565 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:17.947463 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:17.948841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:17.953088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:17.953766 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:17.954244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:17.967715 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:17.971435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:17.972595 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9f2e1083-d5f0-418c-aa15-bd6d6ece41d8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1278 microversion: 2.20 time: 0.220239 Sep 24 15:00:18.012493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 45/76] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:17 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1278 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:18.091229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:18.113337 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-55348296-ce59-42bf-9236-f2acb326d0f3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1273 microversion: 2.1 time: 0.195472 Sep 24 15:00:18.116469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 32/77] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:17 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:18.222646 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:18.223447 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:18.231965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:18.232680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:18.233237 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:18.234171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:18.245344 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:18.247107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:18.576041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:18.587442 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-18b2ab7c-e84b-4eed-8cc8-70690bc65f01 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.374683 Sep 24 15:00:18.588028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 46/78] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:18 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:18.915837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:18.917689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:18.955657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:18.956179 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:18.956629 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:18.959272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:18.961388 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:18.961860 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:19.018959 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:19.019883 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:19.032253 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:19.033367 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:19.034402 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:19.037416 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:19.039097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:19.039750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:19.237859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:19.248569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4abbf5ab-8313-4997-ac8f-2d043c160f9c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1300 microversion: 2.1 time: 0.336513 Sep 24 15:00:19.249626 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 33/79] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:18 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1300 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:19.263794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:19.266007 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:19.304135 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:19.309068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:19.310514 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:19.313573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:19.320482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:19.321369 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:19.757003 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:19.784254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1efc2c25-94b2-4cb6-a9ca-e8259c7a1e02 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1273 microversion: 2.1 time: 0.533166 Sep 24 15:00:19.785433 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 34/80] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:19 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1273 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:19.815037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:19.816335 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:19.844296 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:19.857378 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:19.860068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:19.861546 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:19.863807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:19.865931 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:20.156166 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:20.171741 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:20.192113 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:20.196273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-52e0d319-16ee-4169-8a38-0cdcfe0177a8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1278 microversion: 2.20 time: 1.180657 Sep 24 15:00:20.198085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 47/81] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:19 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1278 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:00:20.277519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:20.278318 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:20.286115 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=4 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:20.288197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:20.288793 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:20.289487 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:20.290903 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:20.291469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:20.291913 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:20.482044 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:20.503998 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-792f68fe-028b-4626-8be3-d4ad5f640acc tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.717123 Sep 24 15:00:20.521581 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 35/82] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:19 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:20.531351 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:20.543037 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-af1ce1a9-bfe5-4dbc-93ce-5827bb6858ed tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1300 microversion: 2.1 time: 0.270778 Sep 24 15:00:20.564317 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 48/83] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:20 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1300 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:20.816569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:20.817630 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:20.819727 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:20.820409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=22 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:20.821189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:20.827384 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:20.827891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:20.828336 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:20.829048 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:20.830190 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:20.830877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:20.933310 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:20.942612 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e2c8316d-0756-412c-9d3b-468b10240b89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1279 microversion: 2.1 time: 0.130543 Sep 24 15:00:20.943281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 36/84] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:20 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1279 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:21.225550 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:21.226922 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:21.233873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:21.234663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:21.235307 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:21.236746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:21.237469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:21.238507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:21.604623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-8d4d6da4-fae0-495a-8b9a-ef45668bb04a req-cf6dbf9b-5447-400f-a965-c5ea06eb80f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1", "tag": "6205a209-bcc7-49c3-a3c4-3b0450b789de"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:21.636339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:21.650812 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:21.652282 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:21.662378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8fbc17cc-0d79-4e2c-9c46-aa7f1bf4b047 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1334 microversion: 2.20 time: 0.437027 Sep 24 15:00:21.663602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 49/85] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:21 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1334 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:21.678963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:21.681047 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:21.691580 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8d4d6da4-fae0-495a-8b9a-ef45668bb04a req-cf6dbf9b-5447-400f-a965-c5ea06eb80f0 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:21.692303 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8d4d6da4-fae0-495a-8b9a-ef45668bb04a req-cf6dbf9b-5447-400f-a965-c5ea06eb80f0 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:21.692889 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8d4d6da4-fae0-495a-8b9a-ef45668bb04a req-cf6dbf9b-5447-400f-a965-c5ea06eb80f0 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:21.695203 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:21.698471 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:21.698982 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:21.699730 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:21.700202 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:21.700636 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:21.716308 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-8d4d6da4-fae0-495a-8b9a-ef45668bb04a req-cf6dbf9b-5447-400f-a965-c5ea06eb80f0 service nova] Creating event network-changed:6205a209-bcc7-49c3-a3c4-3b0450b789de for instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 on hv-cinder-85919 Sep 24 15:00:21.717180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8d4d6da4-fae0-495a-8b9a-ef45668bb04a req-cf6dbf9b-5447-400f-a965-c5ea06eb80f0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120591) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 15:00:21.727623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8d4d6da4-fae0-495a-8b9a-ef45668bb04a req-cf6dbf9b-5447-400f-a965-c5ea06eb80f0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120591) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 15:00:21.729066 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fc0617c-47a7-4b89-87d1-0f83b134f696 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:21.729742 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fc0617c-47a7-4b89-87d1-0f83b134f696 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:21.730438 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fc0617c-47a7-4b89-87d1-0f83b134f696 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:21.731856 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fc0617c-47a7-4b89-87d1-0f83b134f696 None None] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:21.732604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fc0617c-47a7-4b89-87d1-0f83b134f696 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:21.733244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fc0617c-47a7-4b89-87d1-0f83b134f696 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:21.740861 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:21.745346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.compute.rpcapi [None req-1fc0617c-47a7-4b89-87d1-0f83b134f696 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 15:00:21.746854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1fc0617c-47a7-4b89-87d1-0f83b134f696 None None] Releasing lock "compute-rpcapi-router" {{(pid=120591) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 15:00:21.768960 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1fc0617c-47a7-4b89-87d1-0f83b134f696 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350957 Sep 24 15:00:21.770712 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 37/86] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:21.778269 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:21.781659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:21.791338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:21.794190 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:21.795563 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:21.798987 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:21.800529 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:21.802803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:21.807064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=24 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:22.185761 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:22.196999 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a4360726-6086-48d4-b333-2f8458db551f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.422591 Sep 24 15:00:22.199230 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 38/87] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:21 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:22.213981 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:22.214691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:22.229169 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:22.230101 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:22.233209 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:22.239850 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:22.240959 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:22.244288 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:22.263461 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:22.275889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7ca84b54-dc52-4d61-a496-f513f22a940c tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.610924 Sep 24 15:00:22.276499 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 50/88] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:21 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:22.398162 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:22.412996 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8f1e6001-7201-4065-abb6-edcd941bf3c1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1279 microversion: 2.1 time: 0.212442 Sep 24 15:00:22.414243 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 39/89] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:22 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:22.700509 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:22.701135 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:22.716948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:22.718451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:22.726177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:22.727608 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:22.728306 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:22.729182 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:22.864549 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:22.875812 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:22.882623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:22.884031 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3dc3a59e-eb43-4d8d-a62d-438ce539f401 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1334 microversion: 2.20 time: 0.190522 Sep 24 15:00:22.885302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 51/90] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:22 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1334 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:22.891821 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-b6e93472-940c-4a59-b20a-a15862beba93 req-c3f4a03b-b455-46d0-8c25-8843a45b63d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0224c6c-8dba-4b18-97c7-8cab3fc1ffea", "tag": "356965e2-de0a-4518-81de-1ac8443137f4"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:22.929602 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b6e93472-940c-4a59-b20a-a15862beba93 req-c3f4a03b-b455-46d0-8c25-8843a45b63d2 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:22.930118 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b6e93472-940c-4a59-b20a-a15862beba93 req-c3f4a03b-b455-46d0-8c25-8843a45b63d2 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:22.930723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b6e93472-940c-4a59-b20a-a15862beba93 req-c3f4a03b-b455-46d0-8c25-8843a45b63d2 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:22.956814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-b6e93472-940c-4a59-b20a-a15862beba93 req-c3f4a03b-b455-46d0-8c25-8843a45b63d2 service nova] Creating event network-changed:356965e2-de0a-4518-81de-1ac8443137f4 for instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea on hv-cinder-85919 Sep 24 15:00:22.974700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-b6e93472-940c-4a59-b20a-a15862beba93 req-c3f4a03b-b455-46d0-8c25-8843a45b63d2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161928 Sep 24 15:00:22.978834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 40/91] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:00:23.224825 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:23.225441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:23.231903 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:23.232620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:23.233233 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:23.234143 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:23.258951 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:23.259421 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:23.309457 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:23.310243 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:23.318826 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:23.331869 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:23.332631 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:23.333390 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:23.333861 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:23.334327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:23.579764 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:23.583585 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:23.598429 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c97f44a9-982e-4b4a-92e4-7e66d3a2bb86 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.377427 Sep 24 15:00:23.605706 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 52/92] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:23 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:23.624446 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:23.627202 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:23.643419 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:23.644807 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:23.645814 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:23.647331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:23.648506 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:23.655291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:23.776301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:23.790869 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bf9e5660-15c3-4a8a-ba05-0b6e09c08a26 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.493722 Sep 24 15:00:23.794103 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 41/93] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:23 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:23.831470 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:23.856783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fdde6717-a050-47df-b0e7-063ecf9991e6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1279 microversion: 2.1 time: 0.246761 Sep 24 15:00:23.857552 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 53/94] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:23 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:23.917575 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:23.919265 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:23.939087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:23.941131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:23.944220 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:23.946501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:23.947366 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:23.948932 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:24.259650 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:24.286089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:24.291933 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:24.295049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-24a8b689-f00b-4ce6-8470-fcc07bcb9738 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1334 microversion: 2.20 time: 0.383561 Sep 24 15:00:24.296753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 42/95] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:23 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1334 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:24.628863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:24.629488 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:24.638992 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:24.642971 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:24.643595 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:24.644574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:24.645178 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:24.645771 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:24.817816 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:24.820745 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:24.846465 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:24.847119 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:24.852430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:24.855860 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:24.857428 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:24.864292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:25.219383 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:25.229454 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-585140c0-9ef7-4a6c-a066-31ea6accadec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.416579 Sep 24 15:00:25.230080 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 43/96] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:24 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:25.245842 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:25.245842 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:25.261411 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:25.261926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:25.269362 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:25.271128 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:25.274348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:25.275283 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:25.578311 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:25.591791 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-492fc5a2-2596-493b-9216-4e857d65b8bf tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.967540 Sep 24 15:00:25.597002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 54/97] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:24 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:25.621748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:25.624145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:25.646377 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:25.647813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:25.649198 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:25.652494 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:25.653845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:25.655842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:25.881851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:25.916625 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:25.923959 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:25.925124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6bc0f5e5-698d-41cd-af64-2b5ff50feb81 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1342 microversion: 2.20 time: 0.326862 Sep 24 15:00:25.954875 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 55/98] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:25 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1342 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:26.254623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:26.255862 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:26.265863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:26.280532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:26.281772 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:26.285124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:26.286259 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:26.288363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:26.291772 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:26.471600 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:26.492592 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-89cc027e-40cf-43d5-ae05-cac62b711595 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 1.261142 Sep 24 15:00:26.494328 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 44/99] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:25 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:26.630035 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:26.631489 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:26.660741 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:26.663331 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:26.665834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:26.690816 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:26.695720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:26.698348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:26.953834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:26.965989 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-da68f480-b716-4f16-b36e-e30da902f1c2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.346726 Sep 24 15:00:26.977926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 45/100] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:26 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:26.977926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:26.977926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:26.984879 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:26.986359 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:26.986997 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:26.987805 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:26.988638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:26.989491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:27.119105 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:27.143871 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:27.153518 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:27.159646 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e62eaf5a-2c31-4f6f-8395-4cc086d19a1b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1340 microversion: 2.20 time: 0.190540 Sep 24 15:00:27.160917 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 46/101] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:26 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1340 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:27.532627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:27.533353 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:27.549612 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:27.550445 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:27.555623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:27.556990 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:27.558247 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:27.561068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:27.901720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:27.912040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1114df03-61d3-43b2-96ee-64e495cbd90c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.384692 Sep 24 15:00:27.913311 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 47/102] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:27 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:27.992137 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:27.992750 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:28.003717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:28.004490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:28.005083 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:28.005971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:28.006572 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:28.007141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:28.408320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:28.418917 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ef18b0fb-6cd9-4962-b4c5-e86679f26ec8 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 2.170064 Sep 24 15:00:28.420039 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 56/103] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:26 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:28.451918 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:28.452851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:28.469286 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:28.477535 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:28.478336 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:28.479280 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:28.482037 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:28.484830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:28.843436 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:28.872687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:28.878881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:28.885278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3ede7fb9-8dba-4b06-9a63-7071470bef57 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1340 microversion: 2.20 time: 0.460781 Sep 24 15:00:28.886163 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 57/104] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:28 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1340 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:28.891121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-b101bcea-b9af-4268-97d2-d514c82955c2 req-8ad7a8d0-b6f0-4d82-a31f-ad549dec554e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab04a4f5-03a9-4af4-b050-f54f2f0821b8", "tag": "425e5416-b421-4837-9184-b721b4762280"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:28.928651 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-b101bcea-b9af-4268-97d2-d514c82955c2 req-8ad7a8d0-b6f0-4d82-a31f-ad549dec554e service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:28.929155 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-b101bcea-b9af-4268-97d2-d514c82955c2 req-8ad7a8d0-b6f0-4d82-a31f-ad549dec554e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:28.929633 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-b101bcea-b9af-4268-97d2-d514c82955c2 req-8ad7a8d0-b6f0-4d82-a31f-ad549dec554e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:28.967613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-b101bcea-b9af-4268-97d2-d514c82955c2 req-8ad7a8d0-b6f0-4d82-a31f-ad549dec554e service nova] Creating event network-changed:425e5416-b421-4837-9184-b721b4762280 for instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 on hv-cinder-85919 Sep 24 15:00:28.968800 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-b101bcea-b9af-4268-97d2-d514c82955c2 req-8ad7a8d0-b6f0-4d82-a31f-ad549dec554e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 15:00:28.969812 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-b101bcea-b9af-4268-97d2-d514c82955c2 req-8ad7a8d0-b6f0-4d82-a31f-ad549dec554e service nova] Acquired lock "compute-rpcapi-router" {{(pid=120590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 15:00:28.971874 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-69aa1f67-f669-4acf-81ef-212033b7ed83 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:28.973065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-69aa1f67-f669-4acf-81ef-212033b7ed83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:28.974111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-69aa1f67-f669-4acf-81ef-212033b7ed83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:28.975476 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-69aa1f67-f669-4acf-81ef-212033b7ed83 None None] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:28.976638 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-69aa1f67-f669-4acf-81ef-212033b7ed83 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:28.978376 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-69aa1f67-f669-4acf-81ef-212033b7ed83 None None] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:29.007318 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.compute.rpcapi [None req-69aa1f67-f669-4acf-81ef-212033b7ed83 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 15:00:29.011318 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-69aa1f67-f669-4acf-81ef-212033b7ed83 None None] Releasing lock "compute-rpcapi-router" {{(pid=120590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 15:00:29.041820 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-69aa1f67-f669-4acf-81ef-212033b7ed83 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153848 Sep 24 15:00:29.043361 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 58/105] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:29.057673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:29.058424 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:29.077941 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:29.080602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:29.083496 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:29.085004 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:29.087080 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:29.089132 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:29.127064 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:29.144338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ef2e7e13-2784-4129-aa69-7d5d18f54428 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 1.152298 Sep 24 15:00:29.144974 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 48/106] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:27 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:29.446467 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:29.447088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:29.456147 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:29.456661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:29.457107 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:29.457830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:29.481979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:29.482304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:29.608516 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:29.625049 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-08d96d97-6407-4612-832e-cebd275a2cb1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.579526 Sep 24 15:00:29.625650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 59/107] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:29 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:29.911695 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:29.912315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:29.935862 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:29.939354 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:29.939354 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:29.939851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:29.940316 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:29.940746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:30.110139 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:30.121880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:30.124065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:30.125714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3c34f34a-3bc4-4618-9168-506226a0db6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1340 microversion: 2.20 time: 0.218508 Sep 24 15:00:30.126881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 60/108] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:29 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1340 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:00:30.171044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:30.171888 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:30.178445 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:30.179207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:30.179856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:30.180781 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:30.181438 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:30.182112 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:30.305286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:30.316049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5e79ea5e-3bc0-46ae-a4fc-511d7b368993 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.873422 Sep 24 15:00:30.317342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 49/109] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:29 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:30.322548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-3e5117b6-0c74-4ceb-aec7-b6072949d298 req-d076f041-2496-4dad-8663-adc33e80202d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f4ffe67-dbf1-42c6-9f36-30a0d09162b5", "tag": "9d6f145d-02f2-4f5f-ae7a-1f247857e1af"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:30.333236 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-3e5117b6-0c74-4ceb-aec7-b6072949d298 req-d076f041-2496-4dad-8663-adc33e80202d service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:30.333718 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-3e5117b6-0c74-4ceb-aec7-b6072949d298 req-d076f041-2496-4dad-8663-adc33e80202d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:30.334179 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-3e5117b6-0c74-4ceb-aec7-b6072949d298 req-d076f041-2496-4dad-8663-adc33e80202d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:30.346806 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-3e5117b6-0c74-4ceb-aec7-b6072949d298 req-d076f041-2496-4dad-8663-adc33e80202d service nova] Creating event network-changed:9d6f145d-02f2-4f5f-ae7a-1f247857e1af for instance 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 on hv-cinder-85919 Sep 24 15:00:30.352370 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-3e5117b6-0c74-4ceb-aec7-b6072949d298 req-d076f041-2496-4dad-8663-adc33e80202d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Sep 24 15:00:30.353777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 50/110] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:30.473201 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:30.482593 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1fb0573f-5f5a-44f2-bfc0-eb35327b58bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.315666 Sep 24 15:00:30.483512 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 61/111] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:30 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:30.656970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:30.657950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:30.666991 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:30.667861 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:30.668282 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:30.669128 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:30.670022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:30.670588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:31.100114 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:31.114050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8c2e9a41-0e5f-4c56-bb4d-7b2d74723ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.467576 Sep 24 15:00:31.116631 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 51/112] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:30 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:31.152141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:31.152755 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:31.161486 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:31.164041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:31.164707 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:31.165587 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:31.166214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:31.172788 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:31.340717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:31.341331 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:31.355543 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:31.356043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:31.356481 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:31.357181 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:31.357737 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:31.358093 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:31.491832 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:31.506845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:31.508715 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:31.509985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8dd67d10-b04b-4026-a1b4-fa1fade46ee2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.361867 Sep 24 15:00:31.510752 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 62/113] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:31 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:31.526509 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:31.529821 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:31.540527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:31.541124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:31.541576 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:31.542467 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:31.543765 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:31.544480 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:31.658082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:31.671234 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fccdddb2-f468-422b-b76c-7b7afc589f66 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.334261 Sep 24 15:00:31.686159 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 52/114] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:31 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:31.739754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:31.752603 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6e0bd55c-f544-4d70-8305-ba1746d58781 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.240727 Sep 24 15:00:31.753742 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 63/115] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:31 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:32.140672 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:32.142300 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:32.156597 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:32.159607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:32.160382 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:32.161014 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:32.162389 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:32.163286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:32.164199 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:32.534571 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:32.538010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:32.540331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:32.543874 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7cd3d2f9-3fc1-4936-8a23-4507cb7a7baf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.408671 Sep 24 15:00:32.549555 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 53/116] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:32 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:32.554554 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:32.555193 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:32.555910 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:32.558957 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:32.560282 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:32.561078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:32.695165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:32.695891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:32.706964 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:32.708255 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:32.708779 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:32.710784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:32.711272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:32.713125 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:32.941819 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:32.958608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f3355a65-9bbd-4483-b99b-44910a0c9dfe tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.265733 Sep 24 15:00:32.960695 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 54/117] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:32 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:32.975611 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:32.977067 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:32.997106 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:32.997664 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:32.998868 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:33.000873 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:33.002884 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:33.004102 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:33.006198 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:33.022381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:33.031505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:33.032700 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2f51c9d7-e911-4664-9037-b398a3df270c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.500888 Sep 24 15:00:33.033245 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 64/118] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:32 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:33.277020 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:33.281619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:33.298602 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f913b6dd-8e72-4a16-abbf-371bcf975285 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.334105 Sep 24 15:00:33.299440 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 55/119] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:32 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:33.526457 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-85648ee6-b82a-4079-8d77-c115a562ca05 req-46bad65d-4381-4546-89e9-6e6b38c51101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b247c5c-f642-4bcf-9c60-4b993f241a74", "tag": "4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:33.552743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-85648ee6-b82a-4079-8d77-c115a562ca05 req-46bad65d-4381-4546-89e9-6e6b38c51101 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:33.553500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-85648ee6-b82a-4079-8d77-c115a562ca05 req-46bad65d-4381-4546-89e9-6e6b38c51101 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:33.553788 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-85648ee6-b82a-4079-8d77-c115a562ca05 req-46bad65d-4381-4546-89e9-6e6b38c51101 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:33.568115 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-85648ee6-b82a-4079-8d77-c115a562ca05 req-46bad65d-4381-4546-89e9-6e6b38c51101 service nova] Creating event network-changed:4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67 for instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 on hv-cinder-85919 Sep 24 15:00:33.572694 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:33.573109 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-85648ee6-b82a-4079-8d77-c115a562ca05 req-46bad65d-4381-4546-89e9-6e6b38c51101 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050027 Sep 24 15:00:33.573185 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:33.573794 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 65/120] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:33.582519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:33.583010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:33.583442 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:33.585880 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:33.587689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:33.589920 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:33.988365 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:33.989441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:34.003167 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:34.004149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:34.004660 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:34.005107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:34.009245 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:34.009732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:34.010200 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:34.015782 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-16bf1c55-be8a-4ba4-97d1-27204bd8b85c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.446962 Sep 24 15:00:34.031633 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 56/121] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:33 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:34.062077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:34.062811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:34.071739 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:34.081325 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:34.081877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:34.082835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:34.083457 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:34.084031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:34.418186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:34.434041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-88df5ac2-ed7e-4d18-b76c-f0a89ac87676 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.450559 Sep 24 15:00:34.437395 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 66/122] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:33 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:34.444860 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:34.448774 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:34.464783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:34.467430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:34.468065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:34.471042 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:34.472203 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:34.473156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:34.550200 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:34.564707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:34.567219 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:34.569279 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7301a1e1-ddd2-4b74-aa63-159b107fa26c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.511216 Sep 24 15:00:34.585230 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 57/123] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:34 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:35.045665 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:35.046508 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:35.059270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:35.060002 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:35.061082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:35.062765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:35.063502 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:35.064323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:35.284700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:35.299778 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-733f6ecf-fa33-4a79-8f3a-9798601d69eb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.263929 Sep 24 15:00:35.311943 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 58/124] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:35 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:35.423796 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:35.458953 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:35.460007 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:35.468002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6b5a6b7a-8c22-4efa-83b6-e2907dcd2eae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 1.029417 Sep 24 15:00:35.468584 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 67/125] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:34 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:35.474334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:35.476583 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:35.478733 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:35.479701 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:35.482558 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:35.483226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:35.597247 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:35.598526 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:35.607449 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:35.608356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:35.609013 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:35.609936 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:35.611331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:35.612312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:35.815428 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:35.829753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d94d6a9e-1462-4cc5-a268-ea638ff37723 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.374686 Sep 24 15:00:35.846134 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:35.856975 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:35.856975 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:35.856975 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d0010ad1-3c5c-4310-97fd-c7c890b63c4d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.260736 Sep 24 15:00:35.857229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 59/126] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:35 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:35.878897 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 68/127] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:35 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:36.041193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-ffb2085c-3436-49fd-bc6f-f93bfafe3e3e req-5eff7f1d-d038-4294-8e3c-dfd224c75b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0224c6c-8dba-4b18-97c7-8cab3fc1ffea", "name": "network-vif-plugged", "status": "completed", "tag": "356965e2-de0a-4518-81de-1ac8443137f4"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:36.053319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ffb2085c-3436-49fd-bc6f-f93bfafe3e3e req-5eff7f1d-d038-4294-8e3c-dfd224c75b9d service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:36.054452 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ffb2085c-3436-49fd-bc6f-f93bfafe3e3e req-5eff7f1d-d038-4294-8e3c-dfd224c75b9d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:36.054898 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ffb2085c-3436-49fd-bc6f-f93bfafe3e3e req-5eff7f1d-d038-4294-8e3c-dfd224c75b9d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:36.070966 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-ffb2085c-3436-49fd-bc6f-f93bfafe3e3e req-5eff7f1d-d038-4294-8e3c-dfd224c75b9d service nova] Creating event network-vif-plugged:356965e2-de0a-4518-81de-1ac8443137f4 for instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea on hv-cinder-85919 Sep 24 15:00:36.076635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-ffb2085c-3436-49fd-bc6f-f93bfafe3e3e req-5eff7f1d-d038-4294-8e3c-dfd224c75b9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221412 Sep 24 15:00:36.077243 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 60/128] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:36.326602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:36.327327 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:36.338581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:36.342008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:36.342507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:36.343333 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:36.343822 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:36.344300 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:36.494812 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:36.495524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:36.511483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:36.511988 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:36.512491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:36.513215 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:36.513851 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:36.514470 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:36.706409 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:36.717747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e0d79af6-8240-4321-8ae4-ec8445cbbb82 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.395414 Sep 24 15:00:36.718507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:36.720297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 69/129] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:36 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:36.729972 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a13565f0-29b7-431f-a317-ad76d47895c9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.238949 Sep 24 15:00:36.731314 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 61/130] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:36 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:36.857937 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:36.858541 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:36.869550 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:36.870735 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:36.872313 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:36.873939 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:36.874759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:36.875341 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:36.899001 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:36.908147 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:36.909460 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:36.924413 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:36.926449 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:36.928104 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:36.928897 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:36.932214 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:36.932775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:37.155689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:37.167210 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:37.171100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:37.174294 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cd66cbe9-6867-47d4-8c47-5b07d4b385be tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.280778 Sep 24 15:00:37.178703 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 62/131] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:36 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:37.342966 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:37.363337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-088b6d4f-650e-4e81-9032-e78174e35487 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.498269 Sep 24 15:00:37.363337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 70/132] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:36 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:37.742741 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:37.743806 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:37.751388 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:37.752448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:37.753138 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:37.754123 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:37.754824 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:37.755351 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:37.756049 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:37.756666 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:37.783773 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:37.786714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:37.787382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:37.790604 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:37.791380 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:37.792118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:38.023872 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:38.035023 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6455b664-fdce-484f-8cf4-9919fea37b70 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.294705 Sep 24 15:00:38.046795 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 63/133] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:37 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:38.085660 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:38.097805 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0f290193-cbbb-4c65-bc76-f1fd0b19d9a7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.346554 Sep 24 15:00:38.100065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 71/134] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:37 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:38.144718 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-18a55991-ab8c-4b84-b4d6-ecdf7d4df8e8 req-9fa31f27-ea47-483a-8c54-2f7bdd14ce2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab04a4f5-03a9-4af4-b050-f54f2f0821b8", "name": "network-vif-plugged", "status": "completed", "tag": "425e5416-b421-4837-9184-b721b4762280"}, {"server_uuid": "08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1", "name": "network-vif-plugged", "status": "completed", "tag": "6205a209-bcc7-49c3-a3c4-3b0450b789de"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:38.164178 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-18a55991-ab8c-4b84-b4d6-ecdf7d4df8e8 req-9fa31f27-ea47-483a-8c54-2f7bdd14ce2d service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:38.165346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-18a55991-ab8c-4b84-b4d6-ecdf7d4df8e8 req-9fa31f27-ea47-483a-8c54-2f7bdd14ce2d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:38.166609 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-18a55991-ab8c-4b84-b4d6-ecdf7d4df8e8 req-9fa31f27-ea47-483a-8c54-2f7bdd14ce2d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:38.200331 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-18a55991-ab8c-4b84-b4d6-ecdf7d4df8e8 req-9fa31f27-ea47-483a-8c54-2f7bdd14ce2d service nova] Creating event network-vif-plugged:425e5416-b421-4837-9184-b721b4762280 for instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 on hv-cinder-85919 Sep 24 15:00:38.202456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-18a55991-ab8c-4b84-b4d6-ecdf7d4df8e8 req-9fa31f27-ea47-483a-8c54-2f7bdd14ce2d service nova] Creating event network-vif-plugged:6205a209-bcc7-49c3-a3c4-3b0450b789de for instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 on hv-cinder-85919 Sep 24 15:00:38.207747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:38.208473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:38.214885 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-18a55991-ab8c-4b84-b4d6-ecdf7d4df8e8 req-9fa31f27-ea47-483a-8c54-2f7bdd14ce2d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080487 Sep 24 15:00:38.215785 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 64/135] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:38.221231 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:38.222564 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:38.224606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:38.226063 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:38.228693 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:38.229270 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:38.391772 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:38.392679 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:38.401888 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:38.402604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:38.403220 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:38.404269 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:38.404879 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:38.405670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:38.457255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:38.466751 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:38.468343 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:38.470638 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-964faf99-6571-42ec-9df6-399a0d056e7e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.268224 Sep 24 15:00:38.471213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 72/136] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:38 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:38.594043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:38.602229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1e441717-56a8-4c95-8f53-aca9494b623e tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.219701 Sep 24 15:00:38.602654 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 65/137] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:38 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:39.061174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:39.061782 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:39.064710 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:39.068472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:39.068974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:39.076551 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:39.077483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:39.078417 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:39.082521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:39.128305 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:39.128919 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:39.138778 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:39.139530 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:39.140426 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:39.143307 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:39.143926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:39.144517 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:39.423455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:39.430837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:39.433374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a1551bbe-b9dc-4f7d-9852-231247384c6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.376143 Sep 24 15:00:39.434781 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 73/138] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:39 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:39.440839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a6cd83d7-edcd-41b9-905d-cf30477b40ef tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.317130 Sep 24 15:00:39.441625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 66/139] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:39 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:39.496177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:39.496804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:39.512601 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:39.513124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:39.513574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:39.514353 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:39.514834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:39.515242 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:39.625566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:39.626900 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:39.634082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:39.634807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:39.635387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:39.636403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:39.636993 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:39.637557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:39.687909 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:39.705418 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:39.707356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:39.708810 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d75633bb-499f-49f8-9641-306cb4847f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.216681 Sep 24 15:00:39.710268 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 74/140] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:39 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:39.851144 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:39.860818 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-59706355-d02e-4776-8908-f055e6dc09fb tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.239409 Sep 24 15:00:39.861458 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 67/141] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:39 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:40.234880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-5145cbd7-6450-424d-bcb2-aaef28fca84f req-80a46ca2-0c99-4e3c-906a-cf02ce8ac192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4ffe67-dbf1-42c6-9f36-30a0d09162b5", "name": "network-vif-plugged", "status": "completed", "tag": "9d6f145d-02f2-4f5f-ae7a-1f247857e1af"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:40.245612 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-5145cbd7-6450-424d-bcb2-aaef28fca84f req-80a46ca2-0c99-4e3c-906a-cf02ce8ac192 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:40.246115 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-5145cbd7-6450-424d-bcb2-aaef28fca84f req-80a46ca2-0c99-4e3c-906a-cf02ce8ac192 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:40.246732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-5145cbd7-6450-424d-bcb2-aaef28fca84f req-80a46ca2-0c99-4e3c-906a-cf02ce8ac192 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:40.262433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-5145cbd7-6450-424d-bcb2-aaef28fca84f req-80a46ca2-0c99-4e3c-906a-cf02ce8ac192 service nova] Creating event network-vif-plugged:9d6f145d-02f2-4f5f-ae7a-1f247857e1af for instance 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 on hv-cinder-85919 Sep 24 15:00:40.269390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-5145cbd7-6450-424d-bcb2-aaef28fca84f req-80a46ca2-0c99-4e3c-906a-cf02ce8ac192 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038218 Sep 24 15:00:40.270350 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 75/142] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:40.473602 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:40.475066 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:40.479362 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:40.480120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:40.483620 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:40.484739 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:40.486264 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:40.487221 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:40.487505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:40.487840 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:40.488754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:40.489000 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:40.489427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:40.489598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:40.490097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:40.490708 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:40.666675 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:40.693662 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2bbf48b6-2dfc-48c5-9fce-1f640129b0c3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.217961 Sep 24 15:00:40.694644 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 76/143] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:40 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:40.709525 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:40.720118 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5dfd4dcb-ba29-4f3e-bee0-6f6f021e9b7a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.251807 Sep 24 15:00:40.722406 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 68/144] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:40 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:40.736853 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:40.737631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:40.744357 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:40.744852 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:40.745451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:40.746381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:40.746833 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:40.747648 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:40.894573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:40.895465 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:40.906723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:40.907640 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:40.909438 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:40.910590 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:40.911424 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:40.914691 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:40.918468 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:40.942591 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:40.944434 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:40.945988 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-257426fe-72cb-493f-a07d-abb44954bf3c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.213203 Sep 24 15:00:40.946973 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 77/145] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:40 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:41.087127 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:41.095333 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e04760eb-cbd8-4389-b894-d12710804dec tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.207999 Sep 24 15:00:41.095916 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 69/146] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:40 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:41.718290 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:41.719211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:41.726363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:41.727224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:41.727668 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:41.728379 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:41.729001 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:41.729445 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:41.748970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:41.750178 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:41.759301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:41.759814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:41.760248 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:41.761048 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:41.763223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:41.763865 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:41.919535 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:41.927371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f79ef663-efe2-44f1-901f-96ef70a553c8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.212857 Sep 24 15:00:41.928719 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 78/147] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:41 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:41.974941 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:41.975669 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:41.983110 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:41.983736 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:41.984435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:41.985877 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:41.986814 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:41.988527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:41.999445 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:42.009093 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5ec9be22-78ad-4954-b3df-32d08c50e051 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.263774 Sep 24 15:00:42.022410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 70/148] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:41 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:42.121937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:42.122835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:42.129241 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:42.130014 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:42.130456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:42.131156 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:42.131775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:42.132199 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:42.217737 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:42.228540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:42.230708 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:42.231930 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3fd3594b-3818-4bda-b620-14e2c837b2a3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.262977 Sep 24 15:00:42.232451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 79/149] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:41 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:00:42.422189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:42.434837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-22857262-3b26-4239-8496-fd3f590455ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1315 microversion: 2.1 time: 0.317737 Sep 24 15:00:42.447280 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 71/150] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:42 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:42.950778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:42.951410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:42.957601 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:42.958128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:42.958566 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:42.959247 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:42.959781 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:42.960149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:43.035087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:43.035829 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:43.044220 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:43.044735 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:43.045184 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:43.045927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:43.046439 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:43.047071 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:43.215706 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:43.224915 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-88e851cb-4981-4ac3-893c-0783d17a83ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.277969 Sep 24 15:00:43.226088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 80/151] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:42 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:43.244134 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:43.252119 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-eec562ad-d833-4977-80f9-48af224d6a4c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1368 microversion: 2.1 time: 0.221618 Sep 24 15:00:43.262123 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 72/152] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:43 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:43.267541 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:43.268386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:43.276829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:43.277612 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:43.278108 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:43.278979 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:43.279511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:43.280011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:43.444724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:43.457468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:43.460450 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:43.461070 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:43.462304 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:43.465455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-93530e7e-8136-4c1a-b71f-f64a69992715 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.209409 Sep 24 15:00:43.466073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 81/153] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:43 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:43.467261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:43.467926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:43.468527 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:43.470929 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:43.471599 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:43.472245 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:43.650971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:43.655837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:43.661287 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3750730b-e3f8-46de-851b-da0cb56f0f53 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1502 microversion: 2.1 time: 0.204591 Sep 24 15:00:43.661866 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 73/154] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:43 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:43.995135 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-75d22f25-8aa8-430f-b87d-053fbc3807fc req-4c10dfdf-026d-48e3-8c90-150ba3661c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b247c5c-f642-4bcf-9c60-4b993f241a74", "name": "network-vif-plugged", "status": "completed", "tag": "4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:44.023121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-75d22f25-8aa8-430f-b87d-053fbc3807fc req-4c10dfdf-026d-48e3-8c90-150ba3661c7e service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:44.023967 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-75d22f25-8aa8-430f-b87d-053fbc3807fc req-4c10dfdf-026d-48e3-8c90-150ba3661c7e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:44.025670 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-75d22f25-8aa8-430f-b87d-053fbc3807fc req-4c10dfdf-026d-48e3-8c90-150ba3661c7e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:44.051928 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-75d22f25-8aa8-430f-b87d-053fbc3807fc req-4c10dfdf-026d-48e3-8c90-150ba3661c7e service nova] Creating event network-vif-plugged:4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67 for instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 on hv-cinder-85919 Sep 24 15:00:44.062933 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-75d22f25-8aa8-430f-b87d-053fbc3807fc req-4c10dfdf-026d-48e3-8c90-150ba3661c7e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071602 Sep 24 15:00:44.075864 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 82/155] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:44.249266 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:44.250166 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:44.257783 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:44.258376 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:44.258816 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:44.259771 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:44.260390 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:44.260977 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:44.276045 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:44.276926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:44.285113 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:44.285611 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:44.286257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:44.287246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:44.287887 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:44.290012 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:44.471083 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:44.474853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:44.480036 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4acc3c86-ec06-4729-b9a9-dd80147aa49c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1557 microversion: 2.1 time: 0.208459 Sep 24 15:00:44.482217 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 83/156] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:44 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1557 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:44.482858 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c88fc591-7d04-47be-b48a-b6b511762b21 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.238245 Sep 24 15:00:44.483426 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 74/157] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:44 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:44.502910 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:44.503530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:44.511509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a7f5487c-7f9f-4109-911f-cb23cd57f917 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:44.512009 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a7f5487c-7f9f-4109-911f-cb23cd57f917 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:44.512147 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:44.513338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:44.514155 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:44.515040 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:44.515648 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:44.516681 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:44.518514 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a7f5487c-7f9f-4109-911f-cb23cd57f917 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:44.519007 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a7f5487c-7f9f-4109-911f-cb23cd57f917 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:44.519464 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a7f5487c-7f9f-4109-911f-cb23cd57f917 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:44.520462 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a7f5487c-7f9f-4109-911f-cb23cd57f917 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:44.525476 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a7f5487c-7f9f-4109-911f-cb23cd57f917 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:44.535374 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a7f5487c-7f9f-4109-911f-cb23cd57f917 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:44.684146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:44.696753 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:44.698699 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a7f5487c-7f9f-4109-911f-cb23cd57f917 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190791 Sep 24 15:00:44.698929 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:44.699801 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 75/158] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Sep 24 15:00:44 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:00:44.700882 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c4907628-8213-4933-ab2b-258c71019a95 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.205991 Sep 24 15:00:44.701418 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 84/159] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:44 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:45.134564 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a6ebf23d-e27e-4cf0-945e-8ad7617865aa tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f810651e-2401-430a-a421-54d888469272"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:45.137350 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a6ebf23d-e27e-4cf0-945e-8ad7617865aa tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:45.143960 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6ebf23d-e27e-4cf0-945e-8ad7617865aa tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:45.144804 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6ebf23d-e27e-4cf0-945e-8ad7617865aa tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:45.145472 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6ebf23d-e27e-4cf0-945e-8ad7617865aa tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:45.146487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6ebf23d-e27e-4cf0-945e-8ad7617865aa tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:45.147138 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6ebf23d-e27e-4cf0-945e-8ad7617865aa tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:45.147855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a6ebf23d-e27e-4cf0-945e-8ad7617865aa tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:45.506774 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:45.507392 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:45.515635 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:45.516184 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:45.516622 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:45.522946 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:45.523680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:45.524280 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:46.048600 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a6ebf23d-e27e-4cf0-945e-8ad7617865aa tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "POST /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.915366 Sep 24 15:00:46.049380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 76/160] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:00:45 2022] POST /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:46.074573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:46.079845 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:46.103266 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:46.106585 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:46.108938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:46.111564 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:46.112193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:46.114364 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:46.335477 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:46.346669 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4bf26f4d-c280-4f34-bdb9-4ee1a5ada989 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.843448 Sep 24 15:00:46.347588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 85/161] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:45 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:46.354112 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:46.367612 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:46.371403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:46.373140 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-66b35619-5afc-4f6a-b96f-1ee11d631250 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.322430 Sep 24 15:00:46.374868 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 77/162] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:46 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:47.121944 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-fdcdad47-ce77-44fb-8d4e-4efc9afdfd7b req-04a1a711-1b9b-4238-acec-a63da05c18fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab04a4f5-03a9-4af4-b050-f54f2f0821b8", "tag": "425e5416-b421-4837-9184-b721b4762280"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:47.131721 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-fdcdad47-ce77-44fb-8d4e-4efc9afdfd7b req-04a1a711-1b9b-4238-acec-a63da05c18fe service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:47.132253 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-fdcdad47-ce77-44fb-8d4e-4efc9afdfd7b req-04a1a711-1b9b-4238-acec-a63da05c18fe service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:47.132699 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-fdcdad47-ce77-44fb-8d4e-4efc9afdfd7b req-04a1a711-1b9b-4238-acec-a63da05c18fe service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:47.145787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-fdcdad47-ce77-44fb-8d4e-4efc9afdfd7b req-04a1a711-1b9b-4238-acec-a63da05c18fe service nova] Creating event network-changed:425e5416-b421-4837-9184-b721b4762280 for instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 on hv-cinder-85919 Sep 24 15:00:47.152638 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-fdcdad47-ce77-44fb-8d4e-4efc9afdfd7b req-04a1a711-1b9b-4238-acec-a63da05c18fe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036399 Sep 24 15:00:47.158988 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 86/163] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:47.379365 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:47.379987 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:47.395787 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:47.396292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:47.397045 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:47.405039 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:47.406127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:47.410639 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:47.411135 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:47.411593 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:47.428785 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:47.429462 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:47.430113 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:47.430969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:47.431574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:47.435410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:47.772442 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:47.784933 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c448e45f-da0f-49f9-b9b7-c6527e80be6e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1321 microversion: 2.1 time: 0.410153 Sep 24 15:00:47.792864 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:47.799197 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 78/164] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:47 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:47.803205 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:47.807634 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:47.809468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f0db1776-43ba-4f5c-8df8-4a50dfa56a30 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1408 microversion: 2.20 time: 0.408850 Sep 24 15:00:47.810752 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 87/165] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:47 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1408 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:48.744342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-207878624", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:48.810546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:48.811255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:48.816831 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] validate_networks() for None {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:00:48.832534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:48.833251 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:48.833977 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:48.836459 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:48.837801 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:48.838531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.222050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:00:49.222476 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:00:49.223699 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:00:49.224223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:00:49.224853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:00:49.235320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:49.240003 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.240681 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.241281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.242469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.243244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.244015 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.254742 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c212f4c1-8bfa-41b4-b461-77836744ea97 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1514 microversion: 2.1 time: 0.441814 Sep 24 15:00:49.257340 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 88/166] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:48 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1514 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:49.263270 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:49.263894 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:49.273531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.276273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.276726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.277598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.278089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.278520 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.283286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Getting quotas for project eddca7f4673e49dc93a6e1c15e78c521. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:00:49.284146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:49.294394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Getting quotas for user d80d5192d7224516bdff0af8c99f5cea and project eddca7f4673e49dc93a6e1c15e78c521. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:00:49.309131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:00:49.314151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:00:49.343446 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:49.384403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-32f86e27-c4f8-4223-a4d6-7eeb82894f91 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643907 Sep 24 15:00:49.385315 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 79/167] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:00:49.395451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:49.399905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:49.413223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.413773 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.414252 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.415041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.415534 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.415971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.447570 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lazy-loading 'flavor' on Instance uuid 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:00:49.454549 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:49.465064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:49.467683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:49.469501 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-55e10b06-b3e9-471c-9c49-2c7512cd4b15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1601 microversion: 2.20 time: 0.212545 Sep 24 15:00:49.484048 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 89/168] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:00:49 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:00:49.509677 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3e87b135-ceb3-4db3-bab4-e29dce5148d2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:49.510430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3e87b135-ceb3-4db3-bab4-e29dce5148d2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:49.578715 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3e87b135-ceb3-4db3-bab4-e29dce5148d2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:49.586924 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3e87b135-ceb3-4db3-bab4-e29dce5148d2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1214 microversion: 2.1 time: 0.091101 Sep 24 15:00:49.587512 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 90/169] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:49 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:49.592535 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b091f486-986a-41ee-b226-ce4619684254 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:49.592951 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b091f486-986a-41ee-b226-ce4619684254 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:49.612434 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b091f486-986a-41ee-b226-ce4619684254 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.616135 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b091f486-986a-41ee-b226-ce4619684254 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.617275 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b091f486-986a-41ee-b226-ce4619684254 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.622386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b091f486-986a-41ee-b226-ce4619684254 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.623068 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b091f486-986a-41ee-b226-ce4619684254 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.623510 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b091f486-986a-41ee-b226-ce4619684254 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.686205 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-395a052e-23ab-4e96-b01b-a967719f2c92 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5/action" status: 200 len: 32 microversion: 2.1 time: 0.296335 Sep 24 15:00:49.687134 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 80/170] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:00:49 2022] POST /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 15:00:49.702001 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:49.703697 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:49.712048 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.713030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.714149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.715075 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:49.715915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:49.716966 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:49.792542 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b091f486-986a-41ee-b226-ce4619684254 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.203673 Sep 24 15:00:49.802837 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 91/171] 10.222.0.61 () {60 vars in 1316 bytes} [Sat Sep 24 15:00:49 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 15:00:49.943111 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:49.952330 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8cb476b9-f17a-4eb4-a193-3f6096fb77cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.258382 Sep 24 15:00:49.955049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 81/172] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:49 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:50.615374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:50.616560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:50.623213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:50.624121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:50.625539 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:50.626560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:50.627466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:50.628078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:50.893653 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:50.903907 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-12098beb-d984-4a50-96d1-e17469714e86 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1266 microversion: 2.1 time: 0.295015 Sep 24 15:00:50.904486 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 92/173] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:50 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:50.977683 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:50.978687 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:50.986305 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:50.987602 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:50.988483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:50.989368 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:50.991152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:50.992033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:51.167027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:51.175327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bff0349f-f76e-4beb-905e-dd561ccb55f1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.202479 Sep 24 15:00:51.175914 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 82/174] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:50 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:51.927922 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:51.929111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:51.935231 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:51.935730 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:51.936172 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:51.936882 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:51.937332 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:51.938603 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:52.049441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:52.067211 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-cf3ccf59-6c82-42ba-ab2d-fb6426808c5f req-20422b5d-6944-4b55-86ee-8297058e3d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b247c5c-f642-4bcf-9c60-4b993f241a74", "tag": "4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:52.067831 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9a466445-5fa8-4b30-9654-1e1d36dfe15f tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1272 microversion: 2.1 time: 0.143135 Sep 24 15:00:52.080153 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 93/175] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:51 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:52.082027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-cf3ccf59-6c82-42ba-ab2d-fb6426808c5f req-20422b5d-6944-4b55-86ee-8297058e3d59 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:52.086041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-cf3ccf59-6c82-42ba-ab2d-fb6426808c5f req-20422b5d-6944-4b55-86ee-8297058e3d59 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:52.086607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-cf3ccf59-6c82-42ba-ab2d-fb6426808c5f req-20422b5d-6944-4b55-86ee-8297058e3d59 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:52.099595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-cf3ccf59-6c82-42ba-ab2d-fb6426808c5f req-20422b5d-6944-4b55-86ee-8297058e3d59 service nova] Creating event network-changed:4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67 for instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 on hv-cinder-85919 Sep 24 15:00:52.105254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-cf3ccf59-6c82-42ba-ab2d-fb6426808c5f req-20422b5d-6944-4b55-86ee-8297058e3d59 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043997 Sep 24 15:00:52.106316 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 83/176] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:00:52.199523 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:52.200373 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:52.208808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:52.209496 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:52.210293 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:52.211170 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:52.212079 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:52.212793 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:52.516459 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:52.527089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-60e29266-cac4-48d3-b50b-fab413c334f0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.331953 Sep 24 15:00:52.528556 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 94/177] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:52 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:53.093387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:53.094791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:53.106021 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:53.106532 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:53.115574 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:53.116595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:53.117267 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:53.117858 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:53.437231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:53.448134 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-16468f87-6bd0-4494-9fe2-928b08813e29 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1314 microversion: 2.1 time: 0.357504 Sep 24 15:00:53.450064 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 84/178] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:53 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:53.557565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:53.560105 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:53.575692 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:53.582959 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:53.584932 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:53.587363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:53.588782 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:53.590120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:53.820036 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-26ac4620-2605-4974-9718-4c453a6a8d98 req-0e0d442c-f3a9-4b3d-9bbb-bd206bde73c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1d024d-ed9c-4b19-b862-455ff64f1a6c", "tag": "bfd2acef-cf66-4de5-970f-7052ad82c6bb"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:53.835734 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-26ac4620-2605-4974-9718-4c453a6a8d98 req-0e0d442c-f3a9-4b3d-9bbb-bd206bde73c3 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:53.837423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-26ac4620-2605-4974-9718-4c453a6a8d98 req-0e0d442c-f3a9-4b3d-9bbb-bd206bde73c3 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:53.838409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-26ac4620-2605-4974-9718-4c453a6a8d98 req-0e0d442c-f3a9-4b3d-9bbb-bd206bde73c3 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:53.863590 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-26ac4620-2605-4974-9718-4c453a6a8d98 req-0e0d442c-f3a9-4b3d-9bbb-bd206bde73c3 service nova] Creating event network-changed:bfd2acef-cf66-4de5-970f-7052ad82c6bb for instance ab1d024d-ed9c-4b19-b862-455ff64f1a6c on hv-cinder-85919 Sep 24 15:00:53.872638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-26ac4620-2605-4974-9718-4c453a6a8d98 req-0e0d442c-f3a9-4b3d-9bbb-bd206bde73c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058053 Sep 24 15:00:53.874483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 85/179] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:00:53.893811 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:53.901730 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-73c58282-428e-4262-941d-85afd1d20254 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.351620 Sep 24 15:00:53.902494 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 95/180] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:53 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:54.472284 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:54.473065 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:54.480305 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:54.480800 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:54.481246 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:54.482190 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:54.482632 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:54.483100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:54.646522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:54.654122 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ea99289c-f0c1-4f52-b90b-0669ed3946b2 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1314 microversion: 2.1 time: 0.186164 Sep 24 15:00:54.667311 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 86/181] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:54 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:54.938414 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:54.939663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:54.946672 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:54.947495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:54.948134 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:54.948842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:54.949368 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:54.949972 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:55.093125 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:55.106074 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ef1c8c43-e1a1-487c-8f8c-1b7d017fc4c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.182013 Sep 24 15:00:55.106947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 96/182] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:54 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:55.678802 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:55.679908 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:55.686475 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:55.686971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:55.687436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:55.688510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:55.689025 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:55.689698 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:55.832175 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:55.840226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-87efda4b-eb63-4b32-be3e-789ab0fc5c40 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1314 microversion: 2.1 time: 0.165102 Sep 24 15:00:55.840626 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 87/183] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:55 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:56.131479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:56.133040 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:56.151993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:56.152569 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:56.153130 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:56.153935 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:56.154408 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:56.154845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:56.310984 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:56.320668 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f9c1238c-29b2-4d3c-9a71-43aa1a7cc05e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.193412 Sep 24 15:00:56.321255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 97/184] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:56 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:56.867707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:56.870283 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:56.885713 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:56.886426 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:56.887691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:56.894991 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:56.895765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:56.896314 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:57.058873 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:57.066854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1da6831e-1256-4139-92d0-702f7f5aa424 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1314 microversion: 2.1 time: 0.207567 Sep 24 15:00:57.067432 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 88/185] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:56 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:57.345233 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:57.345854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:57.347707 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=85 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:57.354257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:57.355050 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:57.355864 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:57.357472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:57.358612 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:57.359997 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:57.527648 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:57.537840 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bcc774de-f288-49a7-a2f1-fdffa2edf0af tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.196375 Sep 24 15:00:57.542696 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 98/186] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:57 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:58.091109 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:58.091733 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:58.099689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:58.100223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:58.100848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:58.101550 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:58.102372 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:58.102878 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:58.123073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:58.303862 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:58.322974 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-054d4952-5709-460a-a4e5-8605a559c0a3 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1314 microversion: 2.1 time: 0.236038 Sep 24 15:00:58.330095 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 89/187] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:58 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:00:58.570048 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:58.570790 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:58.576924 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:58.577495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:58.578119 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:58.579470 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:58.579966 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:58.580399 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:58.723162 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:58.732155 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-56409598-8271-499c-bc83-c0fd663175b5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.166526 Sep 24 15:00:58.733099 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 99/188] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:58 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:59.170403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-320385708", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "networks": [{"uuid": "2a2b804d-b03f-425f-a09f-5e19feb97b73"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:00:59.231915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] validate_networks() for [('2a2b804d-b03f-425f-a09f-5e19feb97b73', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:00:59.258464 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:59.304407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:59.346661 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:59.347657 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:59.354679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.355669 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.382880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:59.385025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.386727 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.388482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:59.583194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:00:59.641893 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:00:59.653337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-709035fe-2da5-4c52-aa96-77a78174291c tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1314 microversion: 2.1 time: 0.310588 Sep 24 15:00:59.654619 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 100/189] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:59 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:00:59.660473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:59.660974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:59.667142 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.667831 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.668410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:59.669249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.669865 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.671214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:59.716596 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Going to try to terminate instance {{(pid=120590) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:00:59.717048 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:00:59.717537 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:00:59.718072 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:00:59.719414 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:00:59.720854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:00:59.740098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.740715 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.741460 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:59.742635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.743270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.743707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:59.763472 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Getting quotas for project 934382300f5f4af98706b721ce84ae36. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:00:59.768231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Getting quotas for user 67f6f1b1653246fb82e9d48813db8701 and project 934382300f5f4af98706b721ce84ae36. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:00:59.780124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:00:59.783317 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:00:59.832484 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-96e9cb40-cd65-46d2-8c2f-8a94810bce31 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 204 len: 0 microversion: 2.1 time: 0.175264 Sep 24 15:00:59.833593 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 101/190] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:00:59 2022] DELETE /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:00:59.839688 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:59.842635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-807ad165-efa0-42fa-a20a-0a4f81445dc3 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680514 Sep 24 15:00:59.842881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:59.843696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 90/191] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:00:59.843696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:00:59.843696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:00:59.855942 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.856225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.856443 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.856883 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:59.857001 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.857419 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:59.857579 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.858170 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:00:59.858393 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.858633 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:00:59.859064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:00:59.859325 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:00.031475 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:00.042128 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ea85f4b9-6269-48b7-adb9-5f6a099cc213 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1554 microversion: 2.1 time: 0.196316 Sep 24 15:01:00.043361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 91/192] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:59 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:00.048316 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-30749ef1-b10d-4ed6-ad18-880128057436 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:00.048960 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-30749ef1-b10d-4ed6-ad18-880128057436 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:00.101820 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:00.114433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-43dbf866-7cb7-49dc-8952-b947ca463f2a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.278371 Sep 24 15:01:00.115389 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 102/193] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:00:59 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:00.132066 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-30749ef1-b10d-4ed6-ad18-880128057436 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:00.145955 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-30749ef1-b10d-4ed6-ad18-880128057436 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1213 microversion: 2.1 time: 0.101240 Sep 24 15:01:00.147424 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 92/194] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:00 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:00.163062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-a2306427-6d79-4c29-a9d7-9e9822e845fa req-2eab058d-d64d-4546-9f59-cfe0e2cda85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1d024d-ed9c-4b19-b862-455ff64f1a6c", "name": "network-vif-plugged", "status": "completed", "tag": "bfd2acef-cf66-4de5-970f-7052ad82c6bb"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:00.175298 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a2306427-6d79-4c29-a9d7-9e9822e845fa req-2eab058d-d64d-4546-9f59-cfe0e2cda85f service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:00.176030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a2306427-6d79-4c29-a9d7-9e9822e845fa req-2eab058d-d64d-4546-9f59-cfe0e2cda85f service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:00.176680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a2306427-6d79-4c29-a9d7-9e9822e845fa req-2eab058d-d64d-4546-9f59-cfe0e2cda85f service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:00.190195 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-a2306427-6d79-4c29-a9d7-9e9822e845fa req-2eab058d-d64d-4546-9f59-cfe0e2cda85f service nova] Creating event network-vif-plugged:bfd2acef-cf66-4de5-970f-7052ad82c6bb for instance ab1d024d-ed9c-4b19-b862-455ff64f1a6c on hv-cinder-85919 Sep 24 15:01:00.210057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-a2306427-6d79-4c29-a9d7-9e9822e845fa req-2eab058d-d64d-4546-9f59-cfe0e2cda85f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053417 Sep 24 15:01:00.210871 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 103/195] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:01:00.677298 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:00.678504 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:00.685684 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:00.686405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:00.687248 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:00.688709 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:00.689993 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:00.690831 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:00.841531 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:00.849773 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6e585d3a-ed2b-49b4-9ade-dc50b7f2478b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1314 microversion: 2.1 time: 0.176369 Sep 24 15:01:00.852668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 93/196] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:00 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:01.080296 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:01.081090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:01.087380 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:01.087874 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:01.088382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:01.089092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:01.089558 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:01.090165 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:01.137603 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:01.138521 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:01.144509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:01.145174 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:01.145620 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:01.146420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:01.147266 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:01.147936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:01.229590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:01.242196 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ee738936-b7e6-4e47-8a55-b139027827b3 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1554 microversion: 2.1 time: 0.176772 Sep 24 15:01:01.253969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 104/197] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:01 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:01.253969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:01.253969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:01.263318 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:01.263828 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:01.264276 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:01.265103 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:01.265894 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:01.266370 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:01.310192 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:01.319381 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3481f5b2-6e5e-42bb-86a4-363e7decc311 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.185451 Sep 24 15:01:01.319965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 94/198] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:01 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:01.336717 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:01.345952 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3a8cac7d-6047-493b-b936-da278e758976 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1217 microversion: 2.1 time: 0.101380 Sep 24 15:01:01.346446 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 105/199] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:01 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:01.875240 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:01.875815 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:01.882369 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:01.882954 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:01.883404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:01.884116 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:01.884620 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:01.885069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:02.082423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:02.091916 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f5532bfb-1291-4b71-b860-8938b0b3f32a tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1314 microversion: 2.1 time: 0.220504 Sep 24 15:01:02.092498 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 95/200] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:01 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:02.265379 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:02.266529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:02.272419 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:02.272907 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:02.273351 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:02.274093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:02.274554 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:02.274982 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:02.278997 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:02.347211 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:02.347827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:02.353691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:02.354223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:02.354672 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:02.356903 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:02.357388 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:02.357831 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:02.412681 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:02.421323 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5739bc36-d3cb-4995-a7f4-2d55954a6270 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1554 microversion: 2.1 time: 0.160477 Sep 24 15:01:02.422150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 106/201] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:02 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:02.426906 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:02.427687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:02.434286 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:02.435028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:02.435633 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:02.436495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:02.437230 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:02.437829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:02.503684 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:02.514565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7fd512c2-0b16-40b0-91bb-71b02be5ba62 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1265 microversion: 2.1 time: 0.091081 Sep 24 15:01:02.518068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:02.526565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 107/202] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:02 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:02.536489 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bef5387a-95ac-4d67-8ffd-f95eb80869cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.193666 Sep 24 15:01:02.537241 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 96/203] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:02 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:03.115789 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:03.116408 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:03.122760 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:03.123247 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:03.123687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:03.124517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:03.124984 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:03.127405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:03.407584 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:03.417072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a48aa625-d690-4a53-bb2f-9554da25f88b tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1314 microversion: 2.1 time: 0.305404 Sep 24 15:01:03.417847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 108/204] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:03 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:03.458113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:03.458113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:03.458113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:03.458113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:03.458958 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:03.458958 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:03.458958 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:03.458958 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:03.538769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:03.539393 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:03.545573 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:03.546296 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:03.546955 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:03.548327 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:03.549051 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:03.549639 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:03.602338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:03.611757 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3aeb0318-b3f2-41d0-addf-4af2bfc8ee70 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1554 microversion: 2.1 time: 0.170825 Sep 24 15:01:03.612348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 97/205] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:03 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:03.623351 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:03.624143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:03.632190 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:03.632944 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:03.633394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:03.634895 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:03.635423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:03.635868 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:03.651736 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:03.661710 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7f66d938-2b8a-487b-8bb1-ae4f51e52066 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1265 microversion: 2.1 time: 0.126607 Sep 24 15:01:03.662327 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 109/206] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:03 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:03.816678 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:03.825154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-987a5e14-4131-4c50-9cbe-d1ea6c4f3c8e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.211558 Sep 24 15:01:03.825735 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 98/207] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:03 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:03.869104 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-be039957-8bae-43c8-a10d-632cc3df971a req-810426c9-5cd5-484e-a23c-e61a02242cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0224c6c-8dba-4b18-97c7-8cab3fc1ffea", "name": "network-vif-deleted", "tag": "356965e2-de0a-4518-81de-1ac8443137f4"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:03.879830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-be039957-8bae-43c8-a10d-632cc3df971a req-810426c9-5cd5-484e-a23c-e61a02242cc9 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:03.880318 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-be039957-8bae-43c8-a10d-632cc3df971a req-810426c9-5cd5-484e-a23c-e61a02242cc9 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:03.880754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-be039957-8bae-43c8-a10d-632cc3df971a req-810426c9-5cd5-484e-a23c-e61a02242cc9 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:03.892951 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-be039957-8bae-43c8-a10d-632cc3df971a req-810426c9-5cd5-484e-a23c-e61a02242cc9 service nova] Creating event network-vif-deleted:356965e2-de0a-4518-81de-1ac8443137f4 for instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea on hv-cinder-85919 Sep 24 15:01:03.897993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-be039957-8bae-43c8-a10d-632cc3df971a req-810426c9-5cd5-484e-a23c-e61a02242cc9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033629 Sep 24 15:01:03.901709 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 110/208] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:01:04.441200 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:04.441811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:04.448987 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.449487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.449959 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.450859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.451333 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.451905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.613458 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:04.621193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2fef9fda-19b0-4bc7-80b1-f3c3187117a0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1463 microversion: 2.1 time: 0.184208 Sep 24 15:01:04.621797 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 99/209] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:04 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1463 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:04.636940 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:04.638423 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:04.648397 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.649719 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.650215 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.651542 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.652520 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.653449 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.701244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:04.702882 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:04.720968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.721754 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.722571 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.723634 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.724286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.725614 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.766728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:04.775986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1a6add4f-69de-4051-8c83-93ce9cb757d7 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1346 microversion: 2.1 time: 0.144603 Sep 24 15:01:04.776583 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 111/210] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:04 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:04.782287 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:04.782798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:04.789255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.789666 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.790163 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.790862 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.792493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.794621 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.803333 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:04.813630 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-440393ea-c3b4-4b23-8489-92f9ddd59630 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1273 microversion: 2.1 time: 0.125773 Sep 24 15:01:04.830410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 100/211] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:04 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:04.830490 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Going to try to terminate instance {{(pid=120590) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:01:04.850241 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:04.850855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:04.858421 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.859602 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.860384 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.862667 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.863533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.864119 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.910694 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-904060fc-1db9-4fac-b4d5-3a4bee361fd1 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 204 len: 0 microversion: 2.1 time: 0.132762 Sep 24 15:01:04.911260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 112/212] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:01:04 2022] DELETE /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:01:04.920182 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:04.921341 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:04.928993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.929786 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.930462 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:04.931600 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:04.932412 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:04.933631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:05.083371 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:05.089326 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:05.099161 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-138b1376-b196-4839-a271-8f855de646cf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.253755 Sep 24 15:01:05.099351 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-65e061b8-bbed-47cd-ae30-2e4f7ee24389 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1469 microversion: 2.1 time: 0.183123 Sep 24 15:01:05.100466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 113/213] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:04 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:05.101090 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 101/214] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:04 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:05.799675 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:05.800227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:05.806132 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:05.806627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:05.807078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:05.807778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:05.808238 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:05.808667 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:05.838140 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:05.839720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:05.852244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:05.853069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:05.853590 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:05.854448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:05.855106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:05.855715 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:05.878393 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:05.888905 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bf486809-962d-4240-bccf-057b45935950 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1346 microversion: 2.1 time: 0.093663 Sep 24 15:01:05.889570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 114/215] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:05 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:05.929024 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:05.938798 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ffb2aafc-5cf5-484a-abe1-5144487535dc tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1271 microversion: 2.1 time: 0.104226 Sep 24 15:01:05.939222 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 102/216] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:05 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:06.122258 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:06.122925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:06.123032 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:06.123679 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:06.129416 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:06.129935 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:06.130786 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:06.131377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:06.131482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:06.132138 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:06.132478 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:06.132678 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:06.133322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:06.133478 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:06.133968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:06.134615 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:06.298887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:06.309578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e5d93a97-9d82-439a-92e6-b11f235511a9 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1469 microversion: 2.1 time: 0.190467 Sep 24 15:01:06.313524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 103/217] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:06 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1469 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:06.522024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:06.532194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9a73ccfb-1a6c-4414-be49-c6ea43f510c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.413604 Sep 24 15:01:06.532790 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 115/218] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:06 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:06.914435 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:06.916141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:06.929121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:06.929620 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:06.930109 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:06.930827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:06.931289 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:06.931719 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:06.967069 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:06.969983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:06.978395 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:06.980112 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:06.980728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:06.982307 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:06.982728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:06.983266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:06.983389 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:06.983786 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:06.984253 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lazy-loading 'fault' on Instance uuid d0224c6c-8dba-4b18-97c7-8cab3fc1ffea {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:01:06.984479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:07.048270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:07.057254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-40a62a00-2420-4650-85c8-03ecb1a28f5a tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1351 microversion: 2.1 time: 0.147531 Sep 24 15:01:07.058511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 104/219] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:06 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:07.116008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:07.131798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-eab86aa4-288c-4419-a39c-fcb955261822 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1271 microversion: 2.1 time: 0.172343 Sep 24 15:01:07.133451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 116/220] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:06 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:07.336687 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:07.337428 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:07.343213 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:07.343762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:07.344203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:07.344892 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:07.345352 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:07.345778 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:07.480128 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:07.488692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-13f46bc3-2f95-4569-8a30-d89379b2b304 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1469 microversion: 2.1 time: 0.155622 Sep 24 15:01:07.494079 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 105/221] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:07 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:07.555241 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:07.555953 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:07.563096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:07.563679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:07.564227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:07.565066 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:07.565540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:07.566309 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:07.927910 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:07.941778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6ce8734f-8fe1-4083-a7dc-1835f6d3eaac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.390330 Sep 24 15:01:07.942972 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 117/222] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:07 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:08.082364 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:08.083217 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:08.095913 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.096935 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.097823 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:08.099583 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.100452 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.101570 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:08.168298 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.168797 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.169340 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:08.169814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:08.169814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lazy-loading 'fault' on Instance uuid d0224c6c-8dba-4b18-97c7-8cab3fc1ffea {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:01:08.170758 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:08.180904 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.182634 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.183194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:08.184374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.184986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.186274 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:08.243396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b63ee5b9ac44eb39617b291ac869db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a28fd8d62a54976b961c31176fed822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:08.262491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d60ee456-56e7-413d-a6e9-c58c68e2e86b tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 200 len: 1351 microversion: 2.1 time: 0.185476 Sep 24 15:01:08.263092 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 106/223] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:08 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 1351 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:08.512616 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:08.513220 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:08.519410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.520033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.520480 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:08.521194 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.521652 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.522108 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:08.526395 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:08.632485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:08.641461 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b7c12a54-5bf2-4f73-b758-cc3d35a8854c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.477023 Sep 24 15:01:08.642197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 118/224] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:08 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:08.661602 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:08.669939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-39abea8c-9b3e-4ead-8f7b-7966a11845df tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1469 microversion: 2.1 time: 0.161001 Sep 24 15:01:08.682460 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 107/225] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:08 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:08.813528 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-6b4fefba-1cef-4c76-bc46-ff0540037266 req-d7669d4c-3aaf-4213-a079-098f209c3d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1d024d-ed9c-4b19-b862-455ff64f1a6c", "name": "network-vif-deleted", "tag": "bfd2acef-cf66-4de5-970f-7052ad82c6bb"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:08.824044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-6b4fefba-1cef-4c76-bc46-ff0540037266 req-d7669d4c-3aaf-4213-a079-098f209c3d17 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.825410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-6b4fefba-1cef-4c76-bc46-ff0540037266 req-d7669d4c-3aaf-4213-a079-098f209c3d17 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.825410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-6b4fefba-1cef-4c76-bc46-ff0540037266 req-d7669d4c-3aaf-4213-a079-098f209c3d17 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:08.837379 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-6b4fefba-1cef-4c76-bc46-ff0540037266 req-d7669d4c-3aaf-4213-a079-098f209c3d17 service nova] Creating event network-vif-deleted:bfd2acef-cf66-4de5-970f-7052ad82c6bb for instance ab1d024d-ed9c-4b19-b862-455ff64f1a6c on hv-cinder-85919 Sep 24 15:01:08.842392 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-6b4fefba-1cef-4c76-bc46-ff0540037266 req-d7669d4c-3aaf-4213-a079-098f209c3d17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032539 Sep 24 15:01:08.843137 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 119/226] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:08.965994 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:08.966510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:08.972988 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.973486 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.974014 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:08.974728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:08.975173 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:08.975848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:09.122637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:09.133529 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-980153a8-bf7b-4d1c-ae44-27cd82b12572 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.171548 Sep 24 15:01:09.141307 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 108/227] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:08 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:09.286543 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:09.287249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:09.293275 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:09.293767 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:09.294243 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:09.294946 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:09.295408 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:09.295838 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:09.311538 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] HTTP exception thrown: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Request method failure captured: Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea HTTP/1.1 Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxt1aO_j5XvszJC69k7aCrTytIzheyxwdexyiIe7mriEYa6gIvxZwND2QfBmSzfwnOy5LHyrL8csQ0ho4EqQ4qejTWyNSEcnimmij-n7MFb631guhFv5xq1SoAYEgAxxdunL0V9P6txvDHYR4sPYB-gaxpi_lP-YQW_j21h5QI455bM Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 5a28fd8d62a54976b961c31176fed822 Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:09.318784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a28fd8d62a54976b961c31176fed822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a28fd8d62a54976b961c31176fed822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a28fd8d62a54976b961c31176fed822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a28fd8d62a54976b961c31176fed822"}]}] Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 5a28fd8d62a54976b961c31176fed822 Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-DeleteServersTestJSON-824463873-project Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 5b63ee5b9ac44eb39617b291ac869db7 Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-DeleteServersTestJSON-824463873-project Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.320330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'd0224c6c-8dba-4b18-97c7-8cab3fc1ffea'} Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:09.321133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.322705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.323989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Returning 404 to user: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:09.323989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-221952ce-c03a-4e9c-8862-1cb48e10f6e1 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 404 len: 111 microversion: 2.1 time: 0.037959 Sep 24 15:01:09.323989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 120/228] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:09 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:01:09.459207 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:09.461456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:09.467814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:09.468485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:09.469474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:09.470210 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:09.470670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:09.471098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:09.483707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] HTTP exception thrown: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Request method failure captured: Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea/os-volume_attachments HTTP/1.1 Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxt1aO_j5XvszJC69k7aCrTytIzheyxwdexyiIe7mriEYa6gIvxZwND2QfBmSzfwnOy5LHyrL8csQ0ho4EqQ4qejTWyNSEcnimmij-n7MFb631guhFv5xq1SoAYEgAxxdunL0V9P6txvDHYR4sPYB-gaxpi_lP-YQW_j21h5QI455bM Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 5a28fd8d62a54976b961c31176fed822 Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:01:09.493396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a28fd8d62a54976b961c31176fed822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a28fd8d62a54976b961c31176fed822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a28fd8d62a54976b961c31176fed822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a28fd8d62a54976b961c31176fed822"}]}] Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 5a28fd8d62a54976b961c31176fed822 Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-DeleteServersTestJSON-824463873-project Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 5b63ee5b9ac44eb39617b291ac869db7 Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-DeleteServersTestJSON-824463873-project Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.494775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'server_id': 'd0224c6c-8dba-4b18-97c7-8cab3fc1ffea'} Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:09.495405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:09.496479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:09.497589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Returning 404 to user: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:09.497589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d3360da5-41d4-4eeb-99c1-28d24bd94c63 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040021 Sep 24 15:01:09.497589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 109/229] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:01:09 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:01:09.664723 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:09.665693 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:09.673325 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:09.673803 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:09.674254 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:09.674948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:09.675400 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:09.675824 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:09.696098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:09.696713 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:09.703890 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:09.704485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:09.704978 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:09.705878 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:09.706594 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:09.707028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:09.752071 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:09.773556 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:09.781520 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3611a764-e89a-4127-8dca-fcb999e523b0 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1427 microversion: 2.1 time: 0.090479 Sep 24 15:01:09.782399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 110/230] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:09 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:09.820049 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:09.828664 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9c1dc4a2-bc45-4296-ab88-f6154f39f92d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.167120 Sep 24 15:01:09.829229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 121/231] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:09 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:10.156899 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:10.157507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:10.159835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=8 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:10.164927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:10.165501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:10.165870 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:10.166568 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:10.167019 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:10.167444 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:10.301802 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:10.309578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-211a2767-eb82-4914-8188-1467e19b9d60 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.156631 Sep 24 15:01:10.310175 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 111/232] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:10 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:10.804969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:10.805586 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:10.811449 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:10.811944 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:10.812388 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:10.813088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:10.813550 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:10.814005 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:10.851747 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:10.852364 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:10.858366 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:10.858857 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:10.859330 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:10.860546 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:10.861005 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:10.861434 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:10.888374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:10.896880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d82591a7-996d-424b-a2ac-14aebbda4aea tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1299 microversion: 2.1 time: 0.095690 Sep 24 15:01:10.897570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 122/233] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:10 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:10.911758 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-eeef75d2-3b3f-4127-9640-d4519370a49e req-4a698e98-5e68-4841-a8e9-de2191cf1d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4608c9-23ef-4d15-9dbf-56c29e428c54", "tag": "399c25df-066b-4e77-8952-72a98c59550d"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:10.926975 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-eeef75d2-3b3f-4127-9640-d4519370a49e req-4a698e98-5e68-4841-a8e9-de2191cf1d5b service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:10.927521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-eeef75d2-3b3f-4127-9640-d4519370a49e req-4a698e98-5e68-4841-a8e9-de2191cf1d5b service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:10.927905 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-eeef75d2-3b3f-4127-9640-d4519370a49e req-4a698e98-5e68-4841-a8e9-de2191cf1d5b service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:10.938163 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:10.940498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-eeef75d2-3b3f-4127-9640-d4519370a49e req-4a698e98-5e68-4841-a8e9-de2191cf1d5b service nova] Creating event network-changed:399c25df-066b-4e77-8952-72a98c59550d for instance aa4608c9-23ef-4d15-9dbf-56c29e428c54 on hv-cinder-85919 Sep 24 15:01:10.947153 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-eeef75d2-3b3f-4127-9640-d4519370a49e req-4a698e98-5e68-4841-a8e9-de2191cf1d5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047920 Sep 24 15:01:10.948479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 123/234] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:11.002864 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:11.010461 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a0d6c80d-27ce-484f-96f0-4787687f3b76 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.162457 Sep 24 15:01:11.011051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 112/235] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:10 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:11.343267 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:11.343912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:11.351402 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:11.351853 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:11.352360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:11.353079 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:11.353544 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:11.354008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:11.549808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:11.558834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bdbda65e-4168-405e-ba02-5a02bcf1cd01 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.229071 Sep 24 15:01:11.559485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 124/236] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:11 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:11.779893 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:11.784228 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:11.805925 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:11.806581 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:11.807225 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:11.808168 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:11.808839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:11.809676 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:11.828666 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] HTTP exception thrown: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Request method failure captured: Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea HTTP/1.1 Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxt1aO_j5XvszJC69k7aCrTytIzheyxwdexyiIe7mriEYa6gIvxZwND2QfBmSzfwnOy5LHyrL8csQ0ho4EqQ4qejTWyNSEcnimmij-n7MFb631guhFv5xq1SoAYEgAxxdunL0V9P6txvDHYR4sPYB-gaxpi_lP-YQW_j21h5QI455bM Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 5a28fd8d62a54976b961c31176fed822 Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:01:11.830969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a28fd8d62a54976b961c31176fed822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a28fd8d62a54976b961c31176fed822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a28fd8d62a54976b961c31176fed822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a28fd8d62a54976b961c31176fed822"}]}] Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 5a28fd8d62a54976b961c31176fed822 Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-DeleteServersTestJSON-824463873-project Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 5b63ee5b9ac44eb39617b291ac869db7 Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-DeleteServersTestJSON-824463873-project Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.833425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': 'd0224c6c-8dba-4b18-97c7-8cab3fc1ffea'} Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:11.834180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.837231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Returning 404 to user: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:11.837231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dbe17e04-86f0-491b-a920-c28bf8c78f91 tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 404 len: 111 microversion: 2.1 time: 0.066190 Sep 24 15:01:11.837231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 113/237] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:01:11 2022] DELETE /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:01:11.843263 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:11.844430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] [instance: d0224c6c-8dba-4b18-97c7-8cab3fc1ffea] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:11.862089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:11.862089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:11.862089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:11.862368 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:11.863043 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:11.863680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:11.877407 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] HTTP exception thrown: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Request method failure captured: Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea HTTP/1.1 Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxt1aO_j5XvszJC69k7aCrTytIzheyxwdexyiIe7mriEYa6gIvxZwND2QfBmSzfwnOy5LHyrL8csQ0ho4EqQ4qejTWyNSEcnimmij-n7MFb631guhFv5xq1SoAYEgAxxdunL0V9P6txvDHYR4sPYB-gaxpi_lP-YQW_j21h5QI455bM Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 5a28fd8d62a54976b961c31176fed822 Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:11.879249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5a28fd8d62a54976b961c31176fed822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5a28fd8d62a54976b961c31176fed822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a28fd8d62a54976b961c31176fed822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5a28fd8d62a54976b961c31176fed822"}]}] Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 5a28fd8d62a54976b961c31176fed822 Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-DeleteServersTestJSON-824463873 Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-DeleteServersTestJSON-824463873-project Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 5b63ee5b9ac44eb39617b291ac869db7 Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-DeleteServersTestJSON-824463873-project Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.880466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'd0224c6c-8dba-4b18-97c7-8cab3fc1ffea'} Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:11.881092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. Sep 24 15:01:11.882141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:11.883121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] Returning 404 to user: Instance d0224c6c-8dba-4b18-97c7-8cab3fc1ffea could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:11.883121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-cd29a3c6-cc86-4410-bea9-c165582f01ed tempest-DeleteServersTestJSON-824463873 tempest-DeleteServersTestJSON-824463873-project] 10.222.0.61 "GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea" status: 404 len: 111 microversion: 2.1 time: 0.042082 Sep 24 15:01:11.883121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 125/238] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:11 2022] GET /compute/v2.1/servers/d0224c6c-8dba-4b18-97c7-8cab3fc1ffea => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:01:11.921148 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:11.921801 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:11.932082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:11.934454 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:11.935446 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:11.936261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:11.936740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:11.937199 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:11.970365 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:11.970859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:11.971318 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:11.971754 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lazy-loading 'fault' on Instance uuid ab1d024d-ed9c-4b19-b862-455ff64f1a6c {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:01:12.012775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80d5192d7224516bdff0af8c99f5cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddca7f4673e49dc93a6e1c15e78c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:12.021493 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e1d6e7f6-6c7d-46a7-b455-421a40fbfbf7 tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 200 len: 1304 microversion: 2.1 time: 0.104474 Sep 24 15:01:12.038795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:12.038795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:12.041228 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 114/239] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:11 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:12.044654 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:12.045149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:12.045650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:12.046378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:12.047029 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:12.047682 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:12.324570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:12.342436 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-218ff0ca-69e5-4659-ad0c-39e88e2ad2db tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.310836 Sep 24 15:01:12.343959 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 126/240] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:12 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:12.594275 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:12.598868 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:12.606384 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:12.607075 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:12.608783 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:12.610157 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:12.610828 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:12.611458 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:12.795354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:12.808410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-aa0005b4-c68d-4f78-b375-e35014512d3a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.227298 Sep 24 15:01:12.822445 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 115/241] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:12 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:13.050445 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:13.052507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] [instance: ab1d024d-ed9c-4b19-b862-455ff64f1a6c] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:13.064644 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:13.065154 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:13.065603 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:13.066342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:13.067244 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:13.067644 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:13.082056 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] HTTP exception thrown: Instance ab1d024d-ed9c-4b19-b862-455ff64f1a6c could not be found. Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Request method failure captured: Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c HTTP/1.1 Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxuezxAZQ7LDV3o6k8oOgOrCEIVjtgvkSvxfHCh5KerJFjxB4jenbw7n0Mfxr2m4D3eMQ51LqceocbQ5sWHN03i9QOM3d-1q69s4q-TOohXCWgDaD75q5hau0G4a77MOFnkLHsUmZP1Nu1gvVbQ3ta8NuVSZksxKanIaSuglfjntYSU Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: eddca7f4673e49dc93a6e1c15e78c521 Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesNegativeTest-1824140036 Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:13.083980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eddca7f4673e49dc93a6e1c15e78c521"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eddca7f4673e49dc93a6e1c15e78c521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eddca7f4673e49dc93a6e1c15e78c521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eddca7f4673e49dc93a6e1c15e78c521"}]}] Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesNegativeTest-1824140036 Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: eddca7f4673e49dc93a6e1c15e78c521 Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesNegativeTest-1824140036 Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesNegativeTest-1824140036-project Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: d80d5192d7224516bdff0af8c99f5cea Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesNegativeTest-1824140036-project Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance ab1d024d-ed9c-4b19-b862-455ff64f1a6c could not be found. Sep 24 15:01:13.085540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'ab1d024d-ed9c-4b19-b862-455ff64f1a6c'} Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1d024d-ed9c-4b19-b862-455ff64f1a6c could not be found. Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:13.086386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1d024d-ed9c-4b19-b862-455ff64f1a6c could not be found. Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1d024d-ed9c-4b19-b862-455ff64f1a6c could not be found. Sep 24 15:01:13.087806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:13.089791 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] Returning 404 to user: Instance ab1d024d-ed9c-4b19-b862-455ff64f1a6c could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:13.090680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-305ab255-a31a-46e2-b694-1f7aa2db6bce tempest-VolumesNegativeTest-1824140036 tempest-VolumesNegativeTest-1824140036-project] 10.222.0.61 "GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c" status: 404 len: 111 microversion: 2.1 time: 0.047900 Sep 24 15:01:13.091241 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 127/242] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:13 2022] GET /compute/v2.1/servers/ab1d024d-ed9c-4b19-b862-455ff64f1a6c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:01:13.367493 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:13.368123 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:13.374278 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:13.374807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:13.379339 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:13.379339 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:13.379339 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:13.379339 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:13.553700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:13.563965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-271885b8-92c4-4c19-979a-af3a45c5f925 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.200846 Sep 24 15:01:13.564867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 116/243] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:13 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:13.833585 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:13.834332 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:13.850200 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:13.850725 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:13.851224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:13.855781 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:13.856438 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:13.863210 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:14.194285 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:14.209791 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ed590807-8983-47c2-a2a5-8bdbd5044095 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.380365 Sep 24 15:01:14.222673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 128/244] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:13 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:14.587410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:14.588021 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:14.598848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:14.599353 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:14.599797 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:14.600516 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:14.600984 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:14.603080 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:14.936043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:14.947077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4770b6d7-f42d-416d-abf4-8625e3bacf3e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.363893 Sep 24 15:01:14.947659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 117/245] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:14 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:15.238136 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:15.239687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:15.259623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:15.260191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:15.260697 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:15.264177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:15.264177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:15.264177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:15.436302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:15.450676 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ab646e9d-1520-4ca6-b8e0-9f85caec88a3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.218500 Sep 24 15:01:15.454709 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 129/246] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:15 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:15.972374 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:15.973038 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:15.978723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:15.980420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:15.981076 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:15.981749 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:15.982758 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:15.983385 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:15.984301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:16.266234 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:16.278845 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b8898b75-5679-4453-96db-3b2ceb1e7b14 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.311210 Sep 24 15:01:16.279626 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 118/247] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:15 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:16.479226 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:16.479933 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:16.488139 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:16.493266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:16.493998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:16.495127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:16.495762 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:16.500043 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:16.843948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:16.858962 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5423f50e-2fd1-4c8b-90a7-10cc1d012877 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.383832 Sep 24 15:01:16.860139 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 130/248] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:16 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:17.305950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:17.306649 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:17.314028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:17.314765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:17.315269 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:17.316028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:17.316552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:17.317076 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:17.607072 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:17.623895 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-10811eb0-6d31-438a-b0c5-dc535993397e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.321717 Sep 24 15:01:17.624492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 119/249] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:17 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:17.885392 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:17.886635 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:17.893824 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:17.894503 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:17.902507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:17.905444 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:17.907536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:17.910835 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:18.053442 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-67cb8d4c-a06b-40c3-8ad3-c16ac0b989a4 req-bf8c12fe-dac9-42a4-8d09-c800fab18860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4608c9-23ef-4d15-9dbf-56c29e428c54", "name": "network-vif-plugged", "status": "completed", "tag": "399c25df-066b-4e77-8952-72a98c59550d"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:18.068492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-67cb8d4c-a06b-40c3-8ad3-c16ac0b989a4 req-bf8c12fe-dac9-42a4-8d09-c800fab18860 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:18.068981 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-67cb8d4c-a06b-40c3-8ad3-c16ac0b989a4 req-bf8c12fe-dac9-42a4-8d09-c800fab18860 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:18.069832 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-67cb8d4c-a06b-40c3-8ad3-c16ac0b989a4 req-bf8c12fe-dac9-42a4-8d09-c800fab18860 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:18.096188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:18.108783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8dc8f4b2-4d3c-4d19-bf18-b2603d7601ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.228205 Sep 24 15:01:18.121933 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-67cb8d4c-a06b-40c3-8ad3-c16ac0b989a4 req-bf8c12fe-dac9-42a4-8d09-c800fab18860 service nova] Creating event network-vif-plugged:399c25df-066b-4e77-8952-72a98c59550d for instance aa4608c9-23ef-4d15-9dbf-56c29e428c54 on hv-cinder-85919 Sep 24 15:01:18.125528 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-67cb8d4c-a06b-40c3-8ad3-c16ac0b989a4 req-bf8c12fe-dac9-42a4-8d09-c800fab18860 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075511 Sep 24 15:01:18.125945 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 131/250] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:17 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:18.126672 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 120/251] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:18.645225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bc646144-4be3-4cf8-b63c-d88adab17804 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Action: 'create', calling method: .version_select at 0x7f7c10ced8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1469438466", "metadata": {"Type": "work"}}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:18.648346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:18.649050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:18.655139 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:18.655636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:18.656083 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:18.656774 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bc646144-4be3-4cf8-b63c-d88adab17804 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Request method failure captured: Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 122 Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxu-kC2oXQtYSdbF4vM7aNCaHmDJpl0z_E6cyrL94Lh6wLTWdugNygbXQ3niHXoSAdfmhPEN2cxbMDJOFWNNDx8IuUyRiq0QgFLNjj_8fHdcOxnq2sJk7N2eme4rn7T6Ajo6WhCfwDk99MU8SbUIv3S_5rp6kvqqFb3j_r-LX9UIeU0 Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:18.656896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a638b5af9be44eaa852493199e8c880f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}] Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 12a7df242e2b4e898d683d42a3836f65 Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1469438466", "metadata": {"Type": "work"}}} Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:01:18.658025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1469438466', 'metadata': {'Type': 'work'}}}} Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise error Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi '#$%' Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:18.658769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 15:01:18.659890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 15:01:18.660883 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 15:01:18.660883 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.661003 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:18.661097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bc646144-4be3-4cf8-b63c-d88adab17804 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:18.661171 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:18.661239 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bc646144-4be3-4cf8-b63c-d88adab17804 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.123471 Sep 24 15:01:18.661239 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 132/252] 10.222.0.61 () {60 vars in 1156 bytes} [Sat Sep 24 15:01:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 15:01:18.668965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-10104f24-2f91-4b7d-8018-07af34b326f8 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Action: 'create', calling method: .version_select at 0x7f7c10cf6940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-475665919", "metadata": {"Type": "work"}}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-10104f24-2f91-4b7d-8018-07af34b326f8 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Request method failure captured: Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 119 Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxu-kC2oXQtYSdbF4vM7aNCaHmDJpl0z_E6cyrL94Lh6wLTWdugNygbXQ3niHXoSAdfmhPEN2cxbMDJOFWNNDx8IuUyRiq0QgFLNjj_8fHdcOxnq2sJk7N2eme4rn7T6Ajo6WhCfwDk99MU8SbUIv3S_5rp6kvqqFb3j_r-LX9UIeU0 Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:18.673118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a638b5af9be44eaa852493199e8c880f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}] Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 12a7df242e2b4e898d683d42a3836f65 Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-475665919", "metadata": {"Type": "work"}}} Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:01:18.674567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-475665919', 'metadata': {'Type': 'work'}}}} Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise error Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi '0' Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:18.675430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 15:01:18.676722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 15:01:18.677723 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 15:01:18.677723 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.677723 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-10104f24-2f91-4b7d-8018-07af34b326f8 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:18.677723 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-10104f24-2f91-4b7d-8018-07af34b326f8 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009135 Sep 24 15:01:18.678366 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 133/253] 10.222.0.61 () {60 vars in 1156 bytes} [Sat Sep 24 15:01:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 15:01:18.684046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c275164f-8ce4-47e9-ba8e-816f0db67561 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Action: 'create', calling method: .version_select at 0x7f7c12351af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-618639015", "metadata": {"Type": "work"}}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c275164f-8ce4-47e9-ba8e-816f0db67561 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Request method failure captured: Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 118 Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxu-kC2oXQtYSdbF4vM7aNCaHmDJpl0z_E6cyrL94Lh6wLTWdugNygbXQ3niHXoSAdfmhPEN2cxbMDJOFWNNDx8IuUyRiq0QgFLNjj_8fHdcOxnq2sJk7N2eme4rn7T6Ajo6WhCfwDk99MU8SbUIv3S_5rp6kvqqFb3j_r-LX9UIeU0 Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:18.688090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a638b5af9be44eaa852493199e8c880f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}] Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 12a7df242e2b4e898d683d42a3836f65 Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-618639015", "metadata": {"Type": "work"}}} Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:01:18.689489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-618639015', 'metadata': {'Type': 'work'}}}} Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise error Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi '' Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:18.694529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 15:01:18.696077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 15:01:18.697283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 15:01:18.697283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.697283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c275164f-8ce4-47e9-ba8e-816f0db67561 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:18.697283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c275164f-8ce4-47e9-ba8e-816f0db67561 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009987 Sep 24 15:01:18.697283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 134/254] 10.222.0.61 () {60 vars in 1156 bytes} [Sat Sep 24 15:01:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 15:01:18.699444 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-01a89201-f0b9-40b3-b2f6-d4ab50913318 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Calling method '.version_select at 0x7f7c10ced280>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:18.727773 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-01a89201-f0b9-40b3-b2f6-d4ab50913318 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] HTTP exception thrown: Volume tempest-invalid-2122161134 could not be found. Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-01a89201-f0b9-40b3-b2f6-d4ab50913318 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Request method failure captured: Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2122161134 HTTP/1.1 Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxu-kC2oXQtYSdbF4vM7aNCaHmDJpl0z_E6cyrL94Lh6wLTWdugNygbXQ3niHXoSAdfmhPEN2cxbMDJOFWNNDx8IuUyRiq0QgFLNjj_8fHdcOxnq2sJk7N2eme4rn7T6Ajo6WhCfwDk99MU8SbUIv3S_5rp6kvqqFb3j_r-LX9UIeU0 Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:18.729705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a638b5af9be44eaa852493199e8c880f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}] Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 12a7df242e2b4e898d683d42a3836f65 Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Volume tempest-invalid-2122161134 could not be found. Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'tempest-invalid-2122161134'} Sep 24 15:01:18.731027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2122161134 could not be found. (HTTP 404) (Request-ID: req-f604dc9c-e3c6-4349-9e31-251a135a33bb) Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.736818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 15:01:18.738181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2122161134 could not be found. Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:18.739746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2122161134 could not be found. Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2122161134 could not be found. Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-01a89201-f0b9-40b3-b2f6-d4ab50913318 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Returning 404 to user: Volume tempest-invalid-2122161134 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-01a89201-f0b9-40b3-b2f6-d4ab50913318 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2122161134" status: 404 len: 99 microversion: 2.1 time: 0.035410 Sep 24 15:01:18.741581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 135/255] 10.222.0.61 () {58 vars in 1218 bytes} [Sat Sep 24 15:01:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2122161134 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 15:01:18.742474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5f2ec4e9-4632-4bdd-8b69-3291a239db50 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004435 Sep 24 15:01:18.742564 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 136/256] 10.222.0.61 () {58 vars in 1140 bytes} [Sat Sep 24 15:01:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 15:01:18.754974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-410f5e9c-3b3b-4d72-b6af-7cf7e38e32f1 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003576 Sep 24 15:01:18.755473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 137/257] 10.222.0.61 () {58 vars in 1137 bytes} [Sat Sep 24 15:01:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 15:01:18.763831 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fc9bcc2e-4cd8-4f37-90ee-64cd6684f8f2 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Calling method '.version_select at 0x7f7c1181fa60>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:18.793618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-fc9bcc2e-4cd8-4f37-90ee-64cd6684f8f2 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] HTTP exception thrown: Volume 06d48744-f985-46cc-b3a4-1dd4e8f73726 could not be found. Sep 24 15:01:18.793747 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fc9bcc2e-4cd8-4f37-90ee-64cd6684f8f2 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Request method failure captured: Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: DELETE /compute/v2.1/os-volumes/06d48744-f985-46cc-b3a4-1dd4e8f73726 HTTP/1.1 Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxu-kC2oXQtYSdbF4vM7aNCaHmDJpl0z_E6cyrL94Lh6wLTWdugNygbXQ3niHXoSAdfmhPEN2cxbMDJOFWNNDx8IuUyRiq0QgFLNjj_8fHdcOxnq2sJk7N2eme4rn7T6Ajo6WhCfwDk99MU8SbUIv3S_5rp6kvqqFb3j_r-LX9UIeU0 Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:18.796320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a638b5af9be44eaa852493199e8c880f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}] Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 12a7df242e2b4e898d683d42a3836f65 Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Volume 06d48744-f985-46cc-b3a4-1dd4e8f73726 could not be found. Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '06d48744-f985-46cc-b3a4-1dd4e8f73726'} Sep 24 15:01:18.798156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06d48744-f985-46cc-b3a4-1dd4e8f73726 could not be found. (HTTP 404) (Request-ID: req-52dfad46-f8de-4788-bf61-cf1c6fa6548c) Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.799011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 15:01:18.800191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06d48744-f985-46cc-b3a4-1dd4e8f73726 could not be found. Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 15:01:18.801378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06d48744-f985-46cc-b3a4-1dd4e8f73726 could not be found. Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06d48744-f985-46cc-b3a4-1dd4e8f73726 could not be found. Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fc9bcc2e-4cd8-4f37-90ee-64cd6684f8f2 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Returning 404 to user: Volume 06d48744-f985-46cc-b3a4-1dd4e8f73726 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fc9bcc2e-4cd8-4f37-90ee-64cd6684f8f2 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/06d48744-f985-46cc-b3a4-1dd4e8f73726" status: 404 len: 109 microversion: 2.1 time: 0.038842 Sep 24 15:01:18.803342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 138/258] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 15:01:18 2022] DELETE /compute/v2.1/os-volumes/06d48744-f985-46cc-b3a4-1dd4e8f73726 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 15:01:18.806753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e4ca9ca7-3dad-4b41-8c75-12e4632820c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.162957 Sep 24 15:01:18.807478 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 121/259] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:18 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:18.809468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3d72b403-170a-4e8d-9fe8-4307df95ef46 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Calling method '.version_select at 0x7f7c10c89c10>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:18.848088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-3d72b403-170a-4e8d-9fe8-4307df95ef46 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] HTTP exception thrown: Volume 2e24b2a2-d025-4284-b0a1-93a26e99352f could not be found. Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3d72b403-170a-4e8d-9fe8-4307df95ef46 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Request method failure captured: Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/os-volumes/2e24b2a2-d025-4284-b0a1-93a26e99352f HTTP/1.1 Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxu-kC2oXQtYSdbF4vM7aNCaHmDJpl0z_E6cyrL94Lh6wLTWdugNygbXQ3niHXoSAdfmhPEN2cxbMDJOFWNNDx8IuUyRiq0QgFLNjj_8fHdcOxnq2sJk7N2eme4rn7T6Ajo6WhCfwDk99MU8SbUIv3S_5rp6kvqqFb3j_r-LX9UIeU0 Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:18.850493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a638b5af9be44eaa852493199e8c880f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a638b5af9be44eaa852493199e8c880f"}]}] Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: a638b5af9be44eaa852493199e8c880f Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesNegativeTest-2113424844 Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 12a7df242e2b4e898d683d42a3836f65 Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesNegativeTest-2113424844-project Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Volume 2e24b2a2-d025-4284-b0a1-93a26e99352f could not be found. Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '2e24b2a2-d025-4284-b0a1-93a26e99352f'} Sep 24 15:01:18.851748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e24b2a2-d025-4284-b0a1-93a26e99352f could not be found. (HTTP 404) (Request-ID: req-f2d303d8-bc32-4fa3-8fe7-5794123eb924) Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.852500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 15:01:18.853507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e24b2a2-d025-4284-b0a1-93a26e99352f could not be found. Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 15:01:18.854546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e24b2a2-d025-4284-b0a1-93a26e99352f could not be found. Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e24b2a2-d025-4284-b0a1-93a26e99352f could not be found. Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3d72b403-170a-4e8d-9fe8-4307df95ef46 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] Returning 404 to user: Volume 2e24b2a2-d025-4284-b0a1-93a26e99352f could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3d72b403-170a-4e8d-9fe8-4307df95ef46 tempest-VolumesNegativeTest-2113424844 tempest-VolumesNegativeTest-2113424844-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2e24b2a2-d025-4284-b0a1-93a26e99352f" status: 404 len: 109 microversion: 2.1 time: 0.046752 Sep 24 15:01:18.855606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 139/260] 10.222.0.61 () {58 vars in 1245 bytes} [Sat Sep 24 15:01:18 2022] GET /compute/v2.1/os-volumes/2e24b2a2-d025-4284-b0a1-93a26e99352f => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:01:19.137624 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:19.138496 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:19.150362 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:19.151409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:19.152538 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:19.157688 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:19.158445 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:19.158905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:19.341086 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:19.352049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-239a446d-84d2-4262-9ec7-0b7e92690975 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.218996 Sep 24 15:01:19.366847 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 122/261] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:19 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:19.830982 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:19.831778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:19.840341 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:19.840913 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:19.841415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:19.842177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:19.842637 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:19.846527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:20.043118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:20.053551 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f1ca43a6-1c75-4482-8644-47caf0d6e56c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1313 microversion: 2.1 time: 0.227282 Sep 24 15:01:20.054166 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 140/262] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:19 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:20.377829 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:20.378524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:20.384972 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:20.385476 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:20.385943 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:20.387006 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:20.391281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:20.392354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:20.547650 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:20.558505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4e034a95-97eb-4560-a7a1-dddeb6b2a0ee tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.185108 Sep 24 15:01:20.560021 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 123/263] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:20 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:21.079289 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:21.080673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:21.087919 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:21.088938 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:21.089687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:21.090909 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:21.091589 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:21.092378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:21.288136 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:21.298209 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-77ba6e68-e801-44fc-9b96-f645658e0d69 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1496 microversion: 2.1 time: 0.223891 Sep 24 15:01:21.298885 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 141/264] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:21 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1496 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:21.585604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:21.586260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:21.594341 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:21.595126 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:21.595810 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:21.596710 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:21.597353 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:21.598009 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:22.030062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:22.031364 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:22.037393 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:22.037889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:22.038669 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:22.039683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:22.040366 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:22.041737 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:22.070275 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:22.076612 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Going to try to terminate instance {{(pid=120590) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:01:22.078041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-909a7f90-937a-4b57-9b4e-bbe54d3a6609 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1520 microversion: 2.1 time: 0.497589 Sep 24 15:01:22.078633 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 124/265] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:21 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:22.186607 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-77a13680-c558-49da-bd44-096bf3f87e84 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 204 len: 0 microversion: 2.1 time: 0.159421 Sep 24 15:01:22.188502 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 142/266] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:01:22 2022] DELETE /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:01:22.204399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:22.205244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:22.211921 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:22.212680 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:22.213343 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:22.214335 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:22.215028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:22.215775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:22.240664 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:22.427837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:22.436254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7c173e96-774d-4fa9-bdf6-607139c4d03c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1502 microversion: 2.1 time: 0.243433 Sep 24 15:01:22.437409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 125/267] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:22 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:23.111795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:23.112536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:23.125666 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:23.126266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:23.126731 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:23.127471 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:23.127942 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:23.128381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:23.373737 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:23.384661 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8c860dae-16cf-455f-83c6-972e27f7f807 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1500 microversion: 2.1 time: 0.286300 Sep 24 15:01:23.385670 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 143/268] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:23 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1500 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:23.410482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:23.411284 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:23.418246 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:23.418730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:23.419572 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:23.420572 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:23.421319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:23.423115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:23.460059 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:23.461157 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:23.467572 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:23.468298 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:23.468918 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:23.470092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:23.470726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:23.471309 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:23.599372 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:23.613892 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0105fc32-ec93-47a6-94e7-965aaa231579 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1515 microversion: 2.1 time: 0.206894 Sep 24 15:01:23.615823 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 126/269] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:23 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:23.679106 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:23.687543 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6aa97d60-2017-415b-b137-d59aa0965c82 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1502 microversion: 2.1 time: 0.231756 Sep 24 15:01:23.688702 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 144/270] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:23 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:24.333361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-785817600", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "networks": [{"uuid": "6a2fe50c-7d1e-4f1b-a34b-7d142d89f8d7"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:24.394284 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] validate_networks() for [('6a2fe50c-7d1e-4f1b-a34b-7d142d89f8d7', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:01:24.720262 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:24.721689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:24.739392 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:24.742704 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:24.743266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:24.744823 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:24.745395 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:24.745850 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:24.848300 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:01:24.848794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:01:24.849340 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:01:24.849597 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:01:24.850692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:01:24.863737 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:24.864228 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:24.864662 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:24.865387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:24.865842 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:24.866292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:24.904380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Getting quotas for project 5e00eaec5c3a4b53b9e39346e792da01. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:01:24.929568 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Getting quotas for user 482233dae68d487ca9b2ff6c69684663 and project 5e00eaec5c3a4b53b9e39346e792da01. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:01:24.948165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:01:24.950573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:01:25.013846 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5c3e84e6-4696-4087-8b7b-c5e21b375013 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684161 Sep 24 15:01:25.021228 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 127/271] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:01:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:01:25.030923 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fd760e8e-fce9-415b-9a34-2361738f2cf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:25.032797 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fd760e8e-fce9-415b-9a34-2361738f2cf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:25.124197 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fd760e8e-fce9-415b-9a34-2361738f2cf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:25.136300 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fd760e8e-fce9-415b-9a34-2361738f2cf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1218 microversion: 2.1 time: 0.109814 Sep 24 15:01:25.146513 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 128/272] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:25 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:25.146513 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:25.147378 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:25.156124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:25.156124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:25.156124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:25.156124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:25.156608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:25.157005 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:25.194594 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lazy-loading 'flavor' on Instance uuid 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:01:25.301418 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-677629cb-4e0f-4af4-a261-5f5a474d9df1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1/action" status: 200 len: 32 microversion: 2.1 time: 0.162284 Sep 24 15:01:25.302251 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 129/273] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:01:25 2022] POST /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 15:01:25.317189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:25.317401 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:25.318168 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:25.325052 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:25.325761 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:25.326519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:25.327435 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:25.328850 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:25.329444 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:25.330202 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8a0d2626-9564-419d-8457-acf296b8fbeb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1502 microversion: 2.1 time: 0.621215 Sep 24 15:01:25.345397 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 145/274] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:24 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1502 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:25.478569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:25.488010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2c1ef585-5bab-454c-8e4b-c9552cb4e762 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.175680 Sep 24 15:01:25.489039 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 130/275] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:25 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:25.814004 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-53693419-6eb0-48a5-9fca-a950faa9c22e req-54baedc5-1a26-4a73-a0df-2854a2b70b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4608c9-23ef-4d15-9dbf-56c29e428c54", "name": "network-vif-deleted", "tag": "399c25df-066b-4e77-8952-72a98c59550d"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:25.824190 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-53693419-6eb0-48a5-9fca-a950faa9c22e req-54baedc5-1a26-4a73-a0df-2854a2b70b62 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:25.824987 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-53693419-6eb0-48a5-9fca-a950faa9c22e req-54baedc5-1a26-4a73-a0df-2854a2b70b62 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:25.825575 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-53693419-6eb0-48a5-9fca-a950faa9c22e req-54baedc5-1a26-4a73-a0df-2854a2b70b62 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:25.838715 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-53693419-6eb0-48a5-9fca-a950faa9c22e req-54baedc5-1a26-4a73-a0df-2854a2b70b62 service nova] Creating event network-vif-deleted:399c25df-066b-4e77-8952-72a98c59550d for instance aa4608c9-23ef-4d15-9dbf-56c29e428c54 on hv-cinder-85919 Sep 24 15:01:25.847525 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-53693419-6eb0-48a5-9fca-a950faa9c22e req-54baedc5-1a26-4a73-a0df-2854a2b70b62 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038378 Sep 24 15:01:25.848419 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 146/276] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:26.163331 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:26.164560 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:26.171011 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:26.171874 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:26.173091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:26.174223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:26.175019 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:26.175452 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:26.270921 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:26.280393 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-78336baf-378d-4a88-8779-a4796254121a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1270 microversion: 2.1 time: 0.120960 Sep 24 15:01:26.281701 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 131/277] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:26 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1270 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:26.359068 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:26.360024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:26.367273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:26.370095 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:26.373616 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:26.373616 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:26.373616 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:26.373616 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:26.374070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:26.409721 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:26.410427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:26.410930 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:26.411404 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lazy-loading 'fault' on Instance uuid aa4608c9-23ef-4d15-9dbf-56c29e428c54 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:01:26.471456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:26.479981 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fda29afe-bce5-4d9e-8816-0abd62f69682 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1303 microversion: 2.1 time: 0.127453 Sep 24 15:01:26.480706 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 147/278] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:26 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:26.514299 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:26.515982 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:26.523229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:26.523733 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:26.524218 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:26.524883 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:26.525882 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:26.526346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:26.672958 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:26.681375 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-823537a7-712c-4b26-be23-6fa21fd76e8b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.170992 Sep 24 15:01:26.682009 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 132/279] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:26 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:27.303845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:27.304465 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:27.310836 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:27.311551 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:27.312679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:27.313434 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:27.313943 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:27.314371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:27.342028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:27.406297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:27.414148 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3321d9d0-bac7-4b94-bd53-577da8f57446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1276 microversion: 2.1 time: 0.114317 Sep 24 15:01:27.415087 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 148/280] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:27 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:27.506049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:27.506675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:27.512866 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:27.513507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:27.514089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:27.514881 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:27.515992 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:27.516494 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:27.553016 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:27.554024 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:27.554432 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:27.554723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lazy-loading 'fault' on Instance uuid aa4608c9-23ef-4d15-9dbf-56c29e428c54 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:01:27.601681 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:27.611080 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e8be19b1-9efd-4d6e-8798-1735a8621941 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 200 len: 1303 microversion: 2.1 time: 0.109194 Sep 24 15:01:27.611996 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 133/281] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:27 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:27.705800 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:27.707468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:27.713770 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:27.714302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:27.714753 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:27.715464 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:27.715926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:27.716358 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:27.983211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:27.992489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8d3442ef-67dd-4e70-a342-0e319283e522 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.291696 Sep 24 15:01:27.994185 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 149/282] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:27 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:28.437704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:28.438623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:28.445262 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:28.446523 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:28.448156 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:28.449420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:28.450081 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:28.450913 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:28.643625 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:28.644985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: aa4608c9-23ef-4d15-9dbf-56c29e428c54] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:28.650513 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:28.654076 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:28.654886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:28.655572 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:28.658236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:28.658909 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:28.659460 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:28.663220 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1af17312-03ef-41b5-aa7f-6f09c699ebf7 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1318 microversion: 2.1 time: 0.228534 Sep 24 15:01:28.664995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 134/283] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:28 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] HTTP exception thrown: Instance aa4608c9-23ef-4d15-9dbf-56c29e428c54 could not be found. Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Request method failure captured: Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 HTTP/1.1 Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxup15RAJzfsTR228yEY4pRWScsF3nB-XiWPhYePe-ilDH5nN86jLxQRH4j-83rEUwYlPFdPGA-ymjmkMoN46ipDguM9r-BYiM-1s_K8xeWgk61EZZkrBtF9Qtw24ItDOKWb-DByXgLw0TzDu0kxQ390qUxIRmtcAD47BLOcPHqIj84 Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 934382300f5f4af98706b721ce84ae36 Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesActionsTest-1991781360 Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:28.678759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_934382300f5f4af98706b721ce84ae36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/934382300f5f4af98706b721ce84ae36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/934382300f5f4af98706b721ce84ae36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/934382300f5f4af98706b721ce84ae36"}]}] Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesActionsTest-1991781360 Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 934382300f5f4af98706b721ce84ae36 Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesActionsTest-1991781360 Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesActionsTest-1991781360-project Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 67f6f1b1653246fb82e9d48813db8701 Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesActionsTest-1991781360-project Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance aa4608c9-23ef-4d15-9dbf-56c29e428c54 could not be found. Sep 24 15:01:28.680225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'aa4608c9-23ef-4d15-9dbf-56c29e428c54'} Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4608c9-23ef-4d15-9dbf-56c29e428c54 could not be found. Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:28.680947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4608c9-23ef-4d15-9dbf-56c29e428c54 could not be found. Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4608c9-23ef-4d15-9dbf-56c29e428c54 could not be found. Sep 24 15:01:28.683996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:28.685227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Returning 404 to user: Instance aa4608c9-23ef-4d15-9dbf-56c29e428c54 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:28.685227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7f1272da-c46e-44bd-b2a4-e50235ac933e tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54" status: 404 len: 111 microversion: 2.1 time: 0.039510 Sep 24 15:01:28.685227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 150/284] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:28 2022] GET /compute/v2.1/servers/aa4608c9-23ef-4d15-9dbf-56c29e428c54 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:01:28.763299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-49aff11a-90b9-49df-a1bd-0e7bc0968076 req-c4ede99a-9744-4c5c-9ed0-62fba94cfa12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7609461c-58d1-45fe-9990-b0d1536f8ab3", "tag": "249a77ef-d91f-4f03-aa48-4803c0645130"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:28.781169 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-49aff11a-90b9-49df-a1bd-0e7bc0968076 req-c4ede99a-9744-4c5c-9ed0-62fba94cfa12 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:28.781657 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-49aff11a-90b9-49df-a1bd-0e7bc0968076 req-c4ede99a-9744-4c5c-9ed0-62fba94cfa12 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:28.782252 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-49aff11a-90b9-49df-a1bd-0e7bc0968076 req-c4ede99a-9744-4c5c-9ed0-62fba94cfa12 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:28.806203 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-49aff11a-90b9-49df-a1bd-0e7bc0968076 req-c4ede99a-9744-4c5c-9ed0-62fba94cfa12 service nova] Creating event network-changed:249a77ef-d91f-4f03-aa48-4803c0645130 for instance 7609461c-58d1-45fe-9990-b0d1536f8ab3 on hv-cinder-85919 Sep 24 15:01:28.816349 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-49aff11a-90b9-49df-a1bd-0e7bc0968076 req-c4ede99a-9744-4c5c-9ed0-62fba94cfa12 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057004 Sep 24 15:01:28.826701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 151/285] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:28.838319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-31441148", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "networks": [{"uuid": "2a2b804d-b03f-425f-a09f-5e19feb97b73"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:28.903614 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] validate_networks() for [('2a2b804d-b03f-425f-a09f-5e19feb97b73', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:01:29.023319 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:29.024252 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:29.030702 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:29.031206 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:29.031655 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:29.032367 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:29.033006 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:29.033443 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:29.261389 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:29.274051 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-efdd08fe-5d8d-4a14-8b5c-0ec6cf0c5123 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.254756 Sep 24 15:01:29.275024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 152/286] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:29 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:29.309501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:01:29.310596 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:01:29.311407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:01:29.312846 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:01:29.313607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:01:29.327581 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:29.328216 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:29.328676 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:29.329424 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:29.330606 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:29.331049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:29.348410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Getting quotas for project 934382300f5f4af98706b721ce84ae36. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:01:29.352750 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Getting quotas for user 67f6f1b1653246fb82e9d48813db8701 and project 934382300f5f4af98706b721ce84ae36. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:01:29.366135 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:01:29.368474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:01:29.424507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-541f74da-a610-479e-937c-1b6cf1b0e0eb tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590473 Sep 24 15:01:29.425189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 135/287] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:01:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:01:29.436176 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0537b790-c0ea-431c-b5b4-0286776d688f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:29.436801 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0537b790-c0ea-431c-b5b4-0286776d688f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:29.505842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0537b790-c0ea-431c-b5b4-0286776d688f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:29.513954 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0537b790-c0ea-431c-b5b4-0286776d688f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1212 microversion: 2.1 time: 0.081627 Sep 24 15:01:29.514993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 153/288] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:29 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:29.690753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:29.691953 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:29.699887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:29.700486 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:29.701033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:29.701744 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:29.702264 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:29.702814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:29.869439 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:29.884023 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3d626318-4526-497a-9c6b-af34098b921e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1318 microversion: 2.1 time: 0.197838 Sep 24 15:01:29.884613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 136/289] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:29 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:30.300132 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:30.300763 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:30.306735 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:30.307403 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:30.307851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:30.308640 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:30.309120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:30.309558 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:30.526659 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:30.538806 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:30.539904 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:30.551901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:30.552400 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:30.553131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:30.554049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:30.554668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:30.555254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:30.556399 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-810596af-eecb-49ad-a466-dab3136b82c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.259306 Sep 24 15:01:30.557153 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 154/290] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:30 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:30.658899 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:30.681026 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7c68c427-9d66-464e-9b14-c91203dba697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1208 microversion: 2.1 time: 0.146755 Sep 24 15:01:30.681832 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 137/291] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:30 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1208 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:30.908214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:30.908829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:30.914953 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:30.915611 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:30.916268 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:30.917134 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:30.917747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:30.918468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:31.144911 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:31.153044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-287e1976-8e21-4c89-978b-8271e8525b84 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1318 microversion: 2.1 time: 0.248730 Sep 24 15:01:31.153655 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 155/292] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:30 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:31.581069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:31.581795 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:31.594413 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:31.595081 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:31.595698 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:31.597039 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:31.598401 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:31.598907 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:31.707888 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:31.709052 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:31.717139 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:31.722621 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:31.724743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:31.725663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:31.727956 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:31.728818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:31.752246 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:31.761319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1143d0bf-025b-42e4-8547-187136d6484e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.184544 Sep 24 15:01:31.762329 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 138/293] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:31 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:31.824380 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:31.836769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4613808b-546d-4937-a978-1142b0606697 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1270 microversion: 2.1 time: 0.134671 Sep 24 15:01:31.837705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 156/294] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:31 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:32.186427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:32.187664 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:32.194601 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:32.195276 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:32.195915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:32.196980 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:32.197581 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:32.198184 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:32.413196 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:32.423283 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-efbd4b69-379d-4422-80dd-b8811638ebc5 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1318 microversion: 2.1 time: 0.240264 Sep 24 15:01:32.424244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 139/295] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:32 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:32.791245 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:32.792304 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:32.812373 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:32.813168 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:32.813630 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:32.814395 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:32.814982 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:32.815430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:32.861096 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:32.861710 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:32.872190 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:32.872695 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:32.873140 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:32.873861 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:32.874749 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:32.875189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:33.096124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:33.112417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ba2e61a1-caf5-483d-b446-0774974908e0 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1312 microversion: 2.1 time: 0.255584 Sep 24 15:01:33.113781 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 140/296] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:32 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1312 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:33.154445 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:33.164361 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b02eba6f-aebd-4a34-9d22-3e1a82fc267a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.382048 Sep 24 15:01:33.164942 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 157/297] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:32 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:33.449952 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:33.451497 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:33.461306 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:33.462094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:33.462722 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:33.463593 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:33.464226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:33.465426 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:33.655701 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:33.664092 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-02df90c1-60e4-4fbf-8bfa-7957d61cc07c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1318 microversion: 2.1 time: 0.219500 Sep 24 15:01:33.664471 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-2d9ba853-0ffe-4420-bd97-9b4a79263828 req-549ba177-9cb0-4531-ad0b-11c6c9520fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13742afa-82a0-4ba4-b356-2897af5577e7", "tag": "6f8d87cc-f20d-4a3e-93f6-bf9d5fb85d35"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:33.665026 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 141/298] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:33 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:33.690176 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-2d9ba853-0ffe-4420-bd97-9b4a79263828 req-549ba177-9cb0-4531-ad0b-11c6c9520fe3 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:33.690680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-2d9ba853-0ffe-4420-bd97-9b4a79263828 req-549ba177-9cb0-4531-ad0b-11c6c9520fe3 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:33.691130 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-2d9ba853-0ffe-4420-bd97-9b4a79263828 req-549ba177-9cb0-4531-ad0b-11c6c9520fe3 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:33.717620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-2d9ba853-0ffe-4420-bd97-9b4a79263828 req-549ba177-9cb0-4531-ad0b-11c6c9520fe3 service nova] Creating event network-changed:6f8d87cc-f20d-4a3e-93f6-bf9d5fb85d35 for instance 13742afa-82a0-4ba4-b356-2897af5577e7 on hv-cinder-85919 Sep 24 15:01:33.724145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-2d9ba853-0ffe-4420-bd97-9b4a79263828 req-549ba177-9cb0-4531-ad0b-11c6c9520fe3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064798 Sep 24 15:01:33.724991 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 158/299] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:01:33.905920 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-b5e3ac6e-9974-4744-afbb-f014853d0453 req-2b1fe9be-9a5e-4030-8238-22fe97609cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7609461c-58d1-45fe-9990-b0d1536f8ab3", "name": "network-vif-plugged", "status": "completed", "tag": "249a77ef-d91f-4f03-aa48-4803c0645130"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:33.919720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b5e3ac6e-9974-4744-afbb-f014853d0453 req-2b1fe9be-9a5e-4030-8238-22fe97609cfb service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:33.920671 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b5e3ac6e-9974-4744-afbb-f014853d0453 req-2b1fe9be-9a5e-4030-8238-22fe97609cfb service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:33.921946 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b5e3ac6e-9974-4744-afbb-f014853d0453 req-2b1fe9be-9a5e-4030-8238-22fe97609cfb service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:33.943695 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:33.957573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-b5e3ac6e-9974-4744-afbb-f014853d0453 req-2b1fe9be-9a5e-4030-8238-22fe97609cfb service nova] Creating event network-vif-plugged:249a77ef-d91f-4f03-aa48-4803c0645130 for instance 7609461c-58d1-45fe-9990-b0d1536f8ab3 on hv-cinder-85919 Sep 24 15:01:33.963539 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-b5e3ac6e-9974-4744-afbb-f014853d0453 req-2b1fe9be-9a5e-4030-8238-22fe97609cfb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061216 Sep 24 15:01:33.965188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 142/300] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:34.136375 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:34.137091 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:34.156567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:34.159073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:34.159530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:34.160848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:34.161477 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:34.162111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:34.191659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:34.192387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:34.199904 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:34.200445 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:34.200889 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:34.201636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:34.202208 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:34.202751 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:34.357623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:34.373391 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d10f87f0-4511-484f-a474-528661072661 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.189185 Sep 24 15:01:34.374040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 143/301] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:34 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:34.391421 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-82a99fea-b3d9-455b-8ae3-076b1522439c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:34.393493 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-82a99fea-b3d9-455b-8ae3-076b1522439c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:34.411552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-82a99fea-b3d9-455b-8ae3-076b1522439c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:34.413386 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-82a99fea-b3d9-455b-8ae3-076b1522439c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:34.413841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-82a99fea-b3d9-455b-8ae3-076b1522439c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:34.415874 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-82a99fea-b3d9-455b-8ae3-076b1522439c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:34.416619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-82a99fea-b3d9-455b-8ae3-076b1522439c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:34.417631 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-82a99fea-b3d9-455b-8ae3-076b1522439c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:34.449161 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-82a99fea-b3d9-455b-8ae3-076b1522439c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/ips" status: 200 len: 149 microversion: 2.1 time: 0.073862 Sep 24 15:01:34.449743 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 144/302] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 15:01:34 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/ips => generated 149 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:34.505553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:34.517747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d9a4ec93-9ec8-415b-b033-d26475bce53a tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1312 microversion: 2.1 time: 0.385706 Sep 24 15:01:34.529929 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 159/303] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:34 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1312 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:34.687835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:34.688739 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:34.695422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:34.698784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:34.699782 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:34.701995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:34.703397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:34.704291 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:34.878557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:34.905666 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6b93461a-d2d8-4640-b20c-8d7d3bc0d45e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1318 microversion: 2.1 time: 0.221250 Sep 24 15:01:34.906594 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 145/304] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:34 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:35.396597 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:35.397146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:35.403040 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:35.403529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:35.403969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:35.404722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:35.405188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:35.405618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:35.541175 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:35.543771 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:35.544395 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:35.550114 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f9d5a287-b90f-4fd7-bcd5-9d7d1849ac41 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.157540 Sep 24 15:01:35.550835 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 160/305] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:35 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:35.551661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:35.552162 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:35.552610 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:35.553459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:35.553954 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:35.554455 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:35.703135 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:35.712284 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-497d46ed-a042-4b7a-84b7-4cab8561322f tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1312 microversion: 2.1 time: 0.172591 Sep 24 15:01:35.712861 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 146/306] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:35 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:35.928953 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:35.929782 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:35.937530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:35.938066 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:35.938543 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:35.939396 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:35.939869 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:35.940327 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:35.967792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-350d3822-f5fb-4ffd-99ae-f80387d525b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f80c3bb-a34d-4002-b1ae-a1359ee46c25"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:35.971235 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-350d3822-f5fb-4ffd-99ae-f80387d525b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:35.977212 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-350d3822-f5fb-4ffd-99ae-f80387d525b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:35.977777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-350d3822-f5fb-4ffd-99ae-f80387d525b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:35.978314 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-350d3822-f5fb-4ffd-99ae-f80387d525b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:35.979097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-350d3822-f5fb-4ffd-99ae-f80387d525b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:35.979887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-350d3822-f5fb-4ffd-99ae-f80387d525b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:35.980382 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-350d3822-f5fb-4ffd-99ae-f80387d525b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:36.107529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:36.115539 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-57ff7785-0731-4f46-a3e1-75a9002cebc0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1318 microversion: 2.1 time: 0.190733 Sep 24 15:01:36.116105 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 161/307] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:35 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:36.573105 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:36.573721 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:36.580312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:36.580798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:36.581264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:36.581983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:36.582445 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:36.582875 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:36.757589 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:36.766175 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-11f25219-51ce-45ba-afa0-0d5a54ddf683 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.196833 Sep 24 15:01:36.766926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 162/308] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:36 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:36.772112 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:36.772924 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:36.779222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:36.779835 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:36.780453 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:36.781376 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-350d3822-f5fb-4ffd-99ae-f80387d525b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817535 Sep 24 15:01:36.781706 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:36.782278 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 147/309] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:01:35 2022] POST /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:01:36.782724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:36.783165 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:36.955347 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:36.967679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f276fc8c-1046-4177-aeb4-39096eaf9871 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1312 microversion: 2.1 time: 0.198809 Sep 24 15:01:36.968698 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 163/310] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:36 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:37.139074 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:37.139894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:37.146114 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:37.146619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:37.147216 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:37.147926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:37.148478 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:37.149005 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:37.279896 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:37.288488 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dbfdec82-2444-417a-834b-d848bca45f91 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1508 microversion: 2.1 time: 0.154732 Sep 24 15:01:37.289053 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 148/311] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:37 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:37.799428 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:37.799847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:37.807077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:37.807981 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:37.808453 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:37.809185 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:37.811339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:37.812391 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:37.990925 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:37.991546 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:37.998222 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:37.998723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:38.000055 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:38.000755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:38.001218 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:38.001654 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:38.044055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:38.052309 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7b17e0c0-fc5d-40e7-8c78-f81b57b8d818 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.262125 Sep 24 15:01:38.052986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 164/312] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:37 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:38.133750 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:38.142088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-64a4d2d1-9c49-4822-b906-93ca27757d2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1312 microversion: 2.1 time: 0.155932 Sep 24 15:01:38.142633 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 149/313] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:37 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:39.075649 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:39.076271 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:39.082819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:39.083320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:39.083764 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:39.084467 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:39.084928 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:39.085362 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:39.164699 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:39.165919 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:39.173124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:39.173612 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:39.174079 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:39.174770 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:39.175227 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:39.175821 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:39.225624 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:39.234451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8f3bfe4a-da38-4ba4-a112-4e8d973c1521 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.162532 Sep 24 15:01:39.235034 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 165/314] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:39 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:39.338859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:39.341616 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:39.349236 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-305e5605-e93e-4d05-9bbe-a8e99be70a44 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1312 microversion: 2.1 time: 0.188355 Sep 24 15:01:39.350082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 150/315] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:39 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:39.739768 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b24f2196-6f9f-4de9-a1c2-5e2f756f082d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:39.740549 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b24f2196-6f9f-4de9-a1c2-5e2f756f082d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:39.746295 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:39.747993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b24f2196-6f9f-4de9-a1c2-5e2f756f082d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:39.748623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b24f2196-6f9f-4de9-a1c2-5e2f756f082d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:39.749231 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b24f2196-6f9f-4de9-a1c2-5e2f756f082d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:39.750104 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b24f2196-6f9f-4de9-a1c2-5e2f756f082d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:39.750818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b24f2196-6f9f-4de9-a1c2-5e2f756f082d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:39.751547 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b24f2196-6f9f-4de9-a1c2-5e2f756f082d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:39.786734 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b24f2196-6f9f-4de9-a1c2-5e2f756f082d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/ips" status: 200 len: 153 microversion: 2.20 time: 0.051256 Sep 24 15:01:39.788056 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 166/316] 10.222.0.61 () {60 vars in 1289 bytes} [Sat Sep 24 15:01:39 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/ips => generated 153 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 15:01:39.907680 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-39af4cf9-b1ba-46b0-877c-7192758bf3e2 req-d08b62ec-cd7d-4a79-9cd2-8e136e41ed46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13742afa-82a0-4ba4-b356-2897af5577e7", "name": "network-vif-plugged", "status": "completed", "tag": "6f8d87cc-f20d-4a3e-93f6-bf9d5fb85d35"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:39.920023 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=14 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:39.922482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-39af4cf9-b1ba-46b0-877c-7192758bf3e2 req-d08b62ec-cd7d-4a79-9cd2-8e136e41ed46 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:39.923164 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-39af4cf9-b1ba-46b0-877c-7192758bf3e2 req-d08b62ec-cd7d-4a79-9cd2-8e136e41ed46 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:39.923812 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-39af4cf9-b1ba-46b0-877c-7192758bf3e2 req-d08b62ec-cd7d-4a79-9cd2-8e136e41ed46 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:39.939706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-39af4cf9-b1ba-46b0-877c-7192758bf3e2 req-d08b62ec-cd7d-4a79-9cd2-8e136e41ed46 service nova] Creating event network-vif-plugged:6f8d87cc-f20d-4a3e-93f6-bf9d5fb85d35 for instance 13742afa-82a0-4ba4-b356-2897af5577e7 on hv-cinder-85919 Sep 24 15:01:39.944473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-39af4cf9-b1ba-46b0-877c-7192758bf3e2 req-d08b62ec-cd7d-4a79-9cd2-8e136e41ed46 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043767 Sep 24 15:01:39.945243 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 151/317] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:40.259958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:40.260806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:40.267494 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:40.267994 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:40.268447 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:40.269156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:40.269628 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:40.270102 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:40.378048 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:40.378795 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:40.381532 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:40.387509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:40.387995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:40.388436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:40.389147 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:40.389639 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:40.390805 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:40.447019 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:40.456891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-40922462-69fb-49be-84dd-f6bac4172195 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.201126 Sep 24 15:01:40.457470 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 167/318] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:40 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:40.526825 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:40.536019 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4a44ba2f-3533-4f4e-a218-011d41fe3d7c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1312 microversion: 2.1 time: 0.163030 Sep 24 15:01:40.536959 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 152/319] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:40 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:41.479265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:41.480013 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:41.486125 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:41.486626 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:41.487072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:41.487771 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:41.488237 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:41.488950 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:41.508359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:41.564487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:41.565842 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:41.574026 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:41.574743 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:41.575396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:41.576194 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:41.576811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:41.578032 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:41.638197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:41.647582 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e4c7eb37-b870-41be-a96e-bb2daa700906 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.172086 Sep 24 15:01:41.648501 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 168/320] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:41 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:41.719607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:41.727636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5d99340f-1285-4ed6-9435-36eb0fca00de tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1312 microversion: 2.1 time: 0.170115 Sep 24 15:01:41.728220 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 153/321] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:41 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:42.670960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:42.671672 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:42.678018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:42.678582 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:42.679087 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:42.679855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:42.680379 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:42.680884 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:42.750911 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:42.751527 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:42.757881 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:42.758400 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:42.758840 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:42.759539 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:42.760035 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:42.760466 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:42.863119 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:42.871260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-524c1e74-61c9-4ce2-8b07-11e237344e81 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.204376 Sep 24 15:01:42.885928 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 169/322] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:42 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:42.903627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:42.912112 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dba2f4c3-de61-4766-8f54-2f259e31c705 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1495 microversion: 2.1 time: 0.164969 Sep 24 15:01:42.914324 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 154/323] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:42 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1495 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:43.340638 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:43.341171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:43.348183 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:43.348675 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:43.349339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:43.350131 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:43.350777 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:43.351209 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:43.376001 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lazy-loading 'flavor' on Instance uuid 0b247c5c-f642-4bcf-9c60-4b993f241a74 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:01:43.617285 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bf1826ba-b383-4b9e-a769-99edf9f34484 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/action" status: 202 len: 0 microversion: 2.20 time: 0.280787 Sep 24 15:01:43.618215 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 170/324] 10.222.0.61 () {62 vars in 1319 bytes} [Sat Sep 24 15:01:43 2022] POST /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:01:43.626894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:43.627643 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:43.634635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:43.635669 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:43.636424 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:43.637312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:43.637991 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:43.638619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:43.786853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:43.795578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:43.797563 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:43.798754 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d0b7d706-2dff-439f-9c6a-70169ee60b2f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.175839 Sep 24 15:01:43.799316 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 155/325] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:43 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:01:43.896317 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:43.897101 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:43.903980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:43.904474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:43.904923 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:43.905667 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:43.906094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:43.907068 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:44.045121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:44.052747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9ce655a1-8cc2-4790-9be8-da8564449e10 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.160658 Sep 24 15:01:44.053253 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 171/326] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:43 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:44.824306 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:44.824931 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:44.831040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:44.831533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:44.832022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:44.832685 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:44.833144 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:44.833576 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:44.965874 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:44.975565 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:44.977031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:44.978229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-eaeedafc-82bd-4ddd-addf-31f53e6f096f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.157814 Sep 24 15:01:44.978827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 156/327] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:44 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:01:45.075542 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:45.076336 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:45.082679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:45.083242 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:45.083762 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:45.084468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:45.084934 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:45.085367 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:45.216421 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:45.224547 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a1e606ba-35b4-43a6-9275-536fca19d4a8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.153432 Sep 24 15:01:45.225236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 172/328] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:45 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:46.007376 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:46.007996 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:46.014405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:46.014896 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:46.015344 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:46.016580 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:46.017036 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:46.017465 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:46.147688 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:46.156105 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:46.157694 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:46.159047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-10b99886-6021-4773-ba3a-4621645dbf1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.155684 Sep 24 15:01:46.159675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 157/329] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:46 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:01:46.250641 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:46.251812 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:46.258146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:46.258575 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:46.259014 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:46.260381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:46.260866 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:46.261296 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:46.451430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:46.452273 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:46.459107 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:46.459717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:46.460578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:46.462100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:46.462985 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:46.464366 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:46.525024 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:01:46.546657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:46.618091 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:46.626487 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-95907de5-c1be-4f97-8486-d5ee6321cfca tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.381455 Sep 24 15:01:46.627046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 173/330] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:46 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:46.636135 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bb9a4a50-243f-409f-a306-b6f15f150428 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "DELETE /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 204 len: 0 microversion: 2.1 time: 0.188231 Sep 24 15:01:46.637018 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 158/331] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:01:46 2022] DELETE /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:01:46.645448 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:46.646071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:46.651842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:46.652800 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:46.653248 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:46.653968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:46.654433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:46.654867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:46.794280 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:46.802646 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-949eb44b-a838-4ece-b26c-da91805a90c9 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1501 microversion: 2.1 time: 0.161132 Sep 24 15:01:46.803203 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 174/332] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:46 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:47.185322 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:47.186157 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:47.192611 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:47.193106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:47.193579 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:47.194314 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:47.194784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:47.195217 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:47.326676 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:47.335395 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:47.336877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:47.338153 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ef11f21e-932f-4825-8b6e-ebd592cc2591 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.157125 Sep 24 15:01:47.338706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 159/333] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:47 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:01:47.648427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:47.649045 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:47.655045 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:47.655539 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:47.655978 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:47.656681 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:47.657144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:47.657574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:47.802023 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:47.814300 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d0641cc5-40da-4c05-bc99-fef2d4fb21ba tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.169647 Sep 24 15:01:47.814984 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 175/334] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:47 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:47.830346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:47.830346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:47.836423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:47.837084 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:47.837681 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:47.838430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:47.838897 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:47.839548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:47.994990 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:48.003617 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4a77b3fb-fced-408e-93e4-1c1956511f2c tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1501 microversion: 2.1 time: 0.179723 Sep 24 15:01:48.004263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 160/335] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:47 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:48.364650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:48.365816 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:48.372465 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:48.372952 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:48.373557 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:48.374477 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:48.375443 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:48.375887 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:48.508830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:48.517511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:48.519015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:48.520167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ccb49912-f8e3-4470-89d6-dde179fc130b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.159690 Sep 24 15:01:48.520723 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 176/336] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:48 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:01:48.841403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:48.842000 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:48.848399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:48.848888 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:48.849326 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:48.850046 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:48.850772 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:48.851208 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:48.998713 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:49.007115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6017cf23-0a05-4f18-8fd1-720848676c35 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.170421 Sep 24 15:01:49.007678 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 161/337] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:48 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:49.026623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:49.027247 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:49.033991 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:49.034491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:49.034935 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:49.035661 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:49.036176 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:49.036604 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:49.173938 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:49.180409 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e059c5f1-53bb-492d-996f-bf57c6339f72 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1501 microversion: 2.1 time: 0.157535 Sep 24 15:01:49.181341 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 177/338] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:49 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:49.545225 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:49.545864 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:49.553068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:49.554198 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:49.555659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:49.559340 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:49.559920 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:49.560367 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:49.738432 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:49.748543 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:49.750913 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:49.752328 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-facf9ec6-fae8-4b70-86bb-8a223eb0ece5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.211633 Sep 24 15:01:49.753602 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 162/339] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:49 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:01:49.845512 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8ccd3d34-a11c-4341-9374-0d086bd4114f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: .version_select at 0x7f7c118a1040>, body: {"keypair": {"name": "tempest-keypair-2045115923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcKDscAT0FMVstRyRPJs3iGzSVz/OnFk9qe7P8GYG87kzsPrDk2pHiR4BGUPyMzZoIKEWoUJG3XU5PdZBZF7sbQHgD3k6TCuY3NFKrGXjuSz3rK+Csu+GZkXyObX5mR5g=="}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:49.864417 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-8ccd3d34-a11c-4341-9374-0d086bd4114f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:01:49.868304 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-8ccd3d34-a11c-4341-9374-0d086bd4114f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for user 9f74f51060554db18bc96199222e9261 and project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:01:49.891141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-defc5ab1-d41d-4e9b-8888-f5a5eda663cc req-26490c7d-0828-452c-9846-6e5db2542141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13742afa-82a0-4ba4-b356-2897af5577e7", "name": "network-vif-deleted", "tag": "6f8d87cc-f20d-4a3e-93f6-bf9d5fb85d35"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:49.894264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8ccd3d34-a11c-4341-9374-0d086bd4114f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054617 Sep 24 15:01:49.894854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 178/340] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:01:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:49.901937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-defc5ab1-d41d-4e9b-8888-f5a5eda663cc req-26490c7d-0828-452c-9846-6e5db2542141 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:49.902486 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-defc5ab1-d41d-4e9b-8888-f5a5eda663cc req-26490c7d-0828-452c-9846-6e5db2542141 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:49.902928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-defc5ab1-d41d-4e9b-8888-f5a5eda663cc req-26490c7d-0828-452c-9846-6e5db2542141 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:49.921736 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-defc5ab1-d41d-4e9b-8888-f5a5eda663cc req-26490c7d-0828-452c-9846-6e5db2542141 service nova] Creating event network-vif-deleted:6f8d87cc-f20d-4a3e-93f6-bf9d5fb85d35 for instance 13742afa-82a0-4ba4-b356-2897af5577e7 on hv-cinder-85919 Sep 24 15:01:49.927673 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-defc5ab1-d41d-4e9b-8888-f5a5eda663cc req-26490c7d-0828-452c-9846-6e5db2542141 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040422 Sep 24 15:01:49.928583 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 163/341] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:50.030576 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:50.031521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:50.037519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:50.038067 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:50.038518 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:50.039210 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:50.039673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:50.040106 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:50.203788 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:50.204790 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:50.211510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:50.212040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:50.212615 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:50.213354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:50.213832 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:50.214274 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:50.220838 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:50.231754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c1d1a105-02b1-440b-9ae9-2517a07e5aae tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.204874 Sep 24 15:01:50.232362 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 179/342] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:50 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:50.323045 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:50.331620 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-99ad10b9-3ca3-44b9-9823-50944ab4311b tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1459 microversion: 2.1 time: 0.131917 Sep 24 15:01:50.332235 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 164/343] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:50 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1459 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:50.778528 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:50.779167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:50.786993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:50.789527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:50.790224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:50.791174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:50.794439 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:50.794894 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.009261 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:51.022158 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:51.024891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:51.026423 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6554cfc0-fee7-4978-b461-d948f1d1d927 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.252557 Sep 24 15:01:51.027064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 180/344] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:50 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:01:51.256224 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:51.257548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:51.268910 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.269688 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.270867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.272123 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.276615 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.277084 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.356576 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:51.357204 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:51.377097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.380359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.380995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.383560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.386336 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.387215 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.434353 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.435150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.436696 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.437236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lazy-loading 'fault' on Instance uuid 13742afa-82a0-4ba4-b356-2897af5577e7 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:01:51.448733 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:51.470905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7acceb58-6549-4e84-8749-cee482de3b1d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1501 microversion: 2.1 time: 0.218537 Sep 24 15:01:51.471905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 165/345] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:51 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1501 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:51.488263 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67f6f1b1653246fb82e9d48813db8701', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934382300f5f4af98706b721ce84ae36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:51.497417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfb67a27-b79f-4160-a374-4c4b26ce2a0d"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:51.500806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-db7020ee-377e-4440-9f7d-ab57333a9d1d tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 200 len: 1302 microversion: 2.1 time: 0.148193 Sep 24 15:01:51.502030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 181/346] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:51 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 1302 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:51.506355 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:51.521669 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.522441 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.523149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1474171023", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a01210a-747c-4b32-8123-27378a645fb5"}], "security_groups": [{"name": "tempest-securitygroup--1422461294"}], "key_name": "tempest-keypair-2045115923", "user_data": "}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:51.523535 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.524667 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.525451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.526220 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.553360 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] HTTP exception thrown: Cannot 'attach_volume' instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 while it is in vm_state rescued Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Request method failure captured: Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: POST /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1/os-volume_attachments HTTP/1.1 Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 74 Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxt12m9EHw1ReQ63WKJGwL5k_xJalUXAkM07UVpT_gYVE14GGtWlhtFZjR37QGL9ZSTflp04sedb--Ff7lrillLu8TRJCvsvmkZJBnSfPamnWIF6E1bx3fVmGjveqb9UTnDa3Z-BgzWTdRKD8e2K7l-mGDiyxT84bDwK6JwOGGWuwpM Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:01:51.556257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}] Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: db5a0bddb68047d68f0c2dd1af0cd57b Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {"volumeAttachment": {"volumeId": "cfb67a27-b79f-4160-a374-4c4b26ce2a0d"}} Sep 24 15:01:51.557848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Cannot 'attach_volume' instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 while it is in vm_state rescued Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'server_id': '08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1', 'body': {'volumeAttachment': {'volumeId': 'cfb67a27-b79f-4160-a374-4c4b26ce2a0d'}}} Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:51.558755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 while it is in vm_state rescued Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:51.559901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:51.560956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:51.560956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:51.560956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 while it is in vm_state rescued Sep 24 15:01:51.560956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:01:51.560956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Returning 409 to user: Cannot 'attach_volume' instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 while it is in vm_state rescued {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:51.560956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6f2f0072-fee5-4142-b2c2-1fce13ba1b7f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066896 Sep 24 15:01:51.560956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 166/347] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:01:51 2022] POST /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 15:01:51.568196 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ad018bb8-d120-4545-a2c2-c77749a37861 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:51.568990 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ad018bb8-d120-4545-a2c2-c77749a37861 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:51.576575 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad018bb8-d120-4545-a2c2-c77749a37861 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.577199 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad018bb8-d120-4545-a2c2-c77749a37861 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.577649 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad018bb8-d120-4545-a2c2-c77749a37861 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.579035 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad018bb8-d120-4545-a2c2-c77749a37861 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.579505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad018bb8-d120-4545-a2c2-c77749a37861 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.580069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ad018bb8-d120-4545-a2c2-c77749a37861 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.661473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ad018bb8-d120-4545-a2c2-c77749a37861 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1/action" status: 202 len: 0 microversion: 2.1 time: 0.097399 Sep 24 15:01:51.665227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] validate_networks() for [('8a01210a-747c-4b32-8123-27378a645fb5', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:01:51.665399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 167/348] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:01:51 2022] POST /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 15:01:51.671149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:51.672509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:51.682395 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.683015 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.683520 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.685185 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:51.685667 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:51.686205 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:51.870447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:51.893519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-47b14cc9-b6b0-49c8-9873-84c6e947fded tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1509 microversion: 2.1 time: 0.225665 Sep 24 15:01:51.894570 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 168/349] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:51 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:52.056805 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:52.060379 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:52.069599 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:52.071207 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:52.074367 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:52.075400 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:52.076860 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:52.077319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:52.262043 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:01:52.262550 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:01:52.263102 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:01:52.263586 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:01:52.264142 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:01:52.294586 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:52.295452 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:52.296108 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:52.297114 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:52.297783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:52.298455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:52.327200 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:01:52.332838 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:52.336081 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for user 9f74f51060554db18bc96199222e9261 and project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:01:52.347428 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:52.349679 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:52.349827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:01:52.351264 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-513e0c22-8459-42b6-a189-b4fed0e4eff8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.298506 Sep 24 15:01:52.351981 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 169/350] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:52 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:01:52.366362 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:01:52.366362 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:52.419070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e7e0acba-17b5-4886-87c7-4aa9a9d2afd2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.904711 Sep 24 15:01:52.420174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 182/351] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:01:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 15:01:52.431688 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b11264c1-e9e0-40dc-a8d5-713f48d4ec6d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:52.432296 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b11264c1-e9e0-40dc-a8d5-713f48d4ec6d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:52.493759 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b11264c1-e9e0-40dc-a8d5-713f48d4ec6d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:52.517613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b11264c1-e9e0-40dc-a8d5-713f48d4ec6d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1242 microversion: 2.1 time: 0.089232 Sep 24 15:01:52.520448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 170/352] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:52 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:52.527759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:52.528467 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] [instance: 13742afa-82a0-4ba4-b356-2897af5577e7] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:52.541137 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:52.541647 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:52.543904 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:52.544648 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:52.545142 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:52.545533 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:52.584900 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] HTTP exception thrown: Instance 13742afa-82a0-4ba4-b356-2897af5577e7 could not be found. Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Request method failure captured: Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 HTTP/1.1 Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxup15RAJzfsTR228yEY4pRWScsF3nB-XiWPhYePe-ilDH5nN86jLxQRH4j-83rEUwYlPFdPGA-ymjmkMoN46ipDguM9r-BYiM-1s_K8xeWgk61EZZkrBtF9Qtw24ItDOKWb-DByXgLw0TzDu0kxQ390qUxIRmtcAD47BLOcPHqIj84 Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 934382300f5f4af98706b721ce84ae36 Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesActionsTest-1991781360 Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:01:52.587926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_934382300f5f4af98706b721ce84ae36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/934382300f5f4af98706b721ce84ae36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/934382300f5f4af98706b721ce84ae36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/934382300f5f4af98706b721ce84ae36"}]}] Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesActionsTest-1991781360 Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 934382300f5f4af98706b721ce84ae36 Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesActionsTest-1991781360 Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesActionsTest-1991781360-project Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 67f6f1b1653246fb82e9d48813db8701 Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesActionsTest-1991781360-project Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 13742afa-82a0-4ba4-b356-2897af5577e7 could not be found. Sep 24 15:01:52.589299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '13742afa-82a0-4ba4-b356-2897af5577e7'} Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13742afa-82a0-4ba4-b356-2897af5577e7 could not be found. Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:01:52.590015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13742afa-82a0-4ba4-b356-2897af5577e7 could not be found. Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13742afa-82a0-4ba4-b356-2897af5577e7 could not be found. Sep 24 15:01:52.591236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:01:52.592279 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] Returning 404 to user: Instance 13742afa-82a0-4ba4-b356-2897af5577e7 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:01:52.592279 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3b037749-4fb3-4964-bbb0-0cb802725f05 tempest-VolumesActionsTest-1991781360 tempest-VolumesActionsTest-1991781360-project] 10.222.0.61 "GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7" status: 404 len: 111 microversion: 2.1 time: 0.068284 Sep 24 15:01:52.598493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 183/353] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:52 2022] GET /compute/v2.1/servers/13742afa-82a0-4ba4-b356-2897af5577e7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:01:52.945844 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:52.946593 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:52.956114 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:52.957785 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:52.960525 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:52.961327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:52.962248 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:52.962798 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:53.180766 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:53.189300 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fe342cde-e5c6-4477-bc86-3290b6233dbf tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1509 microversion: 2.1 time: 0.251547 Sep 24 15:01:53.190244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 171/354] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:52 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:53.388098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:53.388736 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:53.395494 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:53.395992 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:53.396435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:53.397156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:53.397606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:53.398147 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:53.548833 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:53.549420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:53.550037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:53.558304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:53.558747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:53.558898 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:53.559215 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:53.559933 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:53.560353 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:53.560471 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:53.560840 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:53.561752 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a8481044-bdaf-4293-b96b-9d5088c67c2d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.184418 Sep 24 15:01:53.563403 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 184/355] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:53 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:01:53.628894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:53.636528 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-adf1f01f-66ef-4c04-a47f-20a5ab87b8fb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1238 microversion: 2.1 time: 0.090897 Sep 24 15:01:53.637204 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 172/356] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:53 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:54.212560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:54.213177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:54.220289 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:54.220791 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:54.221238 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:54.221968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:54.222439 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:54.222871 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:54.227018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:54.367095 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:54.375984 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-af9f1c5f-4b5a-4662-b0ab-16f6386b4dec tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1509 microversion: 2.1 time: 0.167195 Sep 24 15:01:54.376637 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 185/357] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:54 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:54.588209 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:54.588971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:54.595288 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:54.595784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:54.596229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:54.596923 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:54.597390 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:54.597820 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:54.660667 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:54.661456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:54.668049 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:54.668658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:54.669168 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:54.669989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:54.670755 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:54.671258 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:54.736409 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:54.744834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-557a92fb-a06b-4c28-82d6-451a88986c2d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1238 microversion: 2.1 time: 0.088024 Sep 24 15:01:54.745412 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 186/358] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:54 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:54.787803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:54.799019 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:54.800641 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:54.802039 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5acc6d86-f65f-43fd-82b9-5406b6ca16f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.217686 Sep 24 15:01:54.802727 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 173/359] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:54 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:01:55.398616 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:55.399234 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:55.405473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:55.406004 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:55.406454 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:55.407160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:55.407624 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:55.408053 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:55.541688 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:55.550757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-980149ec-7449-407b-a68b-896bbef00fa8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1515 microversion: 2.1 time: 0.155842 Sep 24 15:01:55.551454 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 187/360] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:55 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:55.774226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:55.774226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:55.784531 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:55.785373 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:55.786122 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:55.787693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:55.787693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:55.788443 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:55.836251 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:55.837539 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:55.847579 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:55.848636 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:55.849304 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:55.850467 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:55.864776 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:55.866213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:55.951717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:55.961279 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9875bc55-8c47-433b-b5d7-27b378d91508 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1294 microversion: 2.1 time: 0.193657 Sep 24 15:01:55.971925 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 174/361] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:55 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1294 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:56.063675 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:56.073301 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:56.074784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:56.076350 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b1dc0dfb-d9eb-4308-90a1-663407085f9d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.252199 Sep 24 15:01:56.076898 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 188/362] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:55 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:01:56.986200 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:56.986824 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:56.999566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:56.999566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:56.999566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:56.999566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:57.000533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:57.000533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:57.001004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:01:57.078751 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:57.083420 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7da55b07-29a7-4866-ac08-01ed4423f3b3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'create', calling method: .version_select at 0x7f7c10c89b80>, body: {"keypair": {"name": "tempest-keypair-1041096166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYPSX/mF9CJ7nKJefFx1reP6C8kW1B48Hb6StIwV2xmr7vS2cUCTMLY5XsAwEs2CpumexJ4AYCB1ewFiJsKMXxnZ6GKrkxxwLABJdWvPdveGx/+rNcWe9M/KO9Rf8DRLg=="}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:57.087108 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-76180796-a201-4b5b-9650-33b648cc34b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1300 microversion: 2.1 time: 0.105130 Sep 24 15:01:57.087884 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 175/363] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:56 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:57.100153 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-7da55b07-29a7-4866-ac08-01ed4423f3b3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Getting quotas for project 578268f34d874bf9835e8ec4cb31ebee. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:01:57.109705 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:57.110563 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:57.112588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-7da55b07-29a7-4866-ac08-01ed4423f3b3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Getting quotas for user db5a0bddb68047d68f0c2dd1af0cd57b and project 578268f34d874bf9835e8ec4cb31ebee. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:01:57.117375 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:57.118062 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:57.118419 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:57.119113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:57.119557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:57.119992 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:57.149922 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7da55b07-29a7-4866-ac08-01ed4423f3b3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070231 Sep 24 15:01:57.150860 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 189/364] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:01:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:01:57.492570 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:57.503703 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:57.505657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:57.506891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3e5a367a-20ff-44cf-9ca6-a2d6ca507cda tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.402824 Sep 24 15:01:57.507483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 176/365] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:57 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:01:58.111471 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:58.112712 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:58.119082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:58.119764 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:58.120392 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:58.121090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:58.121537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:58.122155 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:58.343398 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:58.352804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5d20bfb5-1bd1-4980-8a31-0f82cd1d9a1b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.245626 Sep 24 15:01:58.353619 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 190/366] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:58 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:01:58.502664 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-b774ab58-d94a-41bb-80da-79e39da74f4d req-8f83bec3-49f9-482e-8f8a-000504410688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e9dbe91-58e2-4672-9c57-0ad669724eed", "tag": "785318ab-a784-470a-b060-4ed1ab4ff69e"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:58.518270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b774ab58-d94a-41bb-80da-79e39da74f4d req-8f83bec3-49f9-482e-8f8a-000504410688 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:58.518768 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b774ab58-d94a-41bb-80da-79e39da74f4d req-8f83bec3-49f9-482e-8f8a-000504410688 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:58.519544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b774ab58-d94a-41bb-80da-79e39da74f4d req-8f83bec3-49f9-482e-8f8a-000504410688 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:58.534371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:58.535294 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:58.535857 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-b774ab58-d94a-41bb-80da-79e39da74f4d req-8f83bec3-49f9-482e-8f8a-000504410688 service nova] Creating event network-changed:785318ab-a784-470a-b060-4ed1ab4ff69e for instance 2e9dbe91-58e2-4672-9c57-0ad669724eed on hv-cinder-85919 Sep 24 15:01:58.541440 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-b774ab58-d94a-41bb-80da-79e39da74f4d req-8f83bec3-49f9-482e-8f8a-000504410688 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043170 Sep 24 15:01:58.541845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:58.542555 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:58.543181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:58.543930 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 177/367] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:01:58.544248 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:58.544719 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:58.545757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:58.694240 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:58.704998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:58.707889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:58.710340 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fa2ea2a6-3749-44fa-a456-767a22cb98b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.180039 Sep 24 15:01:58.711484 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 191/368] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:58 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:01:58.841004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1034505817", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cfe3ea10-cfdc-43fc-b917-03b5fac0d633"}], "security_groups": [{"name": "tempest-securitygroup--815810995"}], "key_name": "tempest-keypair-1041096166", "user_data": "}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:01:59.379384 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:59.379992 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:59.392019 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:59.392507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:59.393118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:59.394210 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:59.394815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:59.395382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:59.700511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:01:59.709064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-510b1bb0-af77-4925-a47c-ddd9ab3bedc8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.333327 Sep 24 15:01:59.709664 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 192/369] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:01:59 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:01:59.736313 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:01:59.736927 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:01:59.743024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:59.743521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:59.743961 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:59.744785 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:01:59.745315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:01:59.745855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:01:59.990479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] validate_networks() for [('cfe3ea10-cfdc-43fc-b917-03b5fac0d633', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:02:00.011559 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:00.020181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:00.021634 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:00.022834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-723da913-39b6-4813-a28c-c92ebea41365 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.290543 Sep 24 15:02:00.023407 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 193/370] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:01:59 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:02:00.378337 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:02:00.378769 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:02:00.379250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:02:00.379705 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:02:00.380181 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:02:00.388834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:00.389321 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:00.389760 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:00.391125 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:00.391587 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:00.392018 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:00.408567 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Getting quotas for project 578268f34d874bf9835e8ec4cb31ebee. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:02:00.412764 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Getting quotas for user db5a0bddb68047d68f0c2dd1af0cd57b and project 578268f34d874bf9835e8ec4cb31ebee. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:02:00.430975 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:02:00.433804 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:02:00.482891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-16f021f0-6867-4d06-b5a5-eb4389381115 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.646713 Sep 24 15:02:00.483541 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 178/371] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:01:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:02:00.494653 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5c4e5ce2-0368-4845-a66c-6087192a76e5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:00.495372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-5c4e5ce2-0368-4845-a66c-6087192a76e5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:00.547671 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5c4e5ce2-0368-4845-a66c-6087192a76e5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:00.554881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5c4e5ce2-0368-4845-a66c-6087192a76e5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1246 microversion: 2.1 time: 0.064058 Sep 24 15:02:00.555453 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 194/372] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:00 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1246 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:00.731910 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:00.733005 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:00.741313 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:00.741819 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:00.742326 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:00.743228 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:00.743694 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:00.744160 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:00.880218 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:00.887929 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b3065204-fbb7-4727-ab91-0ec39261bbf5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.160168 Sep 24 15:02:00.888487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 179/373] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:00 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:01.049564 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:01.050215 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:01.056152 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:01.056717 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:01.057435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:01.058179 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:01.058653 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:01.059099 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:01.188320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:01.196485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:01.198035 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:01.199208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4eec3b8e-6142-473c-adac-15ee2a57fb15 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.154251 Sep 24 15:02:01.199946 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 195/374] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:01 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:01.577030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:01.578191 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:01.584068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:01.584558 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:01.585001 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:01.585694 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:01.586192 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:01.586629 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:01.648701 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:01.657266 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-48687a4c-73b8-4539-98e2-6560e6f58128 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1250 microversion: 2.1 time: 0.084107 Sep 24 15:02:01.657835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 180/375] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:01 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:01.910658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:01.911182 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:01.917090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:01.917574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:01.918034 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:01.918720 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:01.919173 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:01.919617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:02.048005 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:02.055478 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ab36a4be-6293-40e3-9515-cd5c864f9005 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.148992 Sep 24 15:02:02.056039 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 196/376] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:01 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:02.224540 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:02.225152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:02.231784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:02.232267 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:02.232699 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:02.233388 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:02.233844 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:02.234808 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:02.360932 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:02.369312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:02.370822 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:02.371988 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8bbd0aeb-8657-4e77-8091-070feb37c091 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.151478 Sep 24 15:02:02.372540 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 181/377] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:02 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:02.679474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:02.680089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:02.681949 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:02.687766 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:02.688265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:02.688712 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:02.689413 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:02.689885 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:02.690342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:02.755125 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:02.762773 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5e59047e-f48f-4ad6-81e4-3e0001a4fb03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1250 microversion: 2.1 time: 0.087223 Sep 24 15:02:02.763387 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 197/378] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:02 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:03.079094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:03.079706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:03.085553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:03.086073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:03.086512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:03.087199 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:03.087656 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:03.088083 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:03.213810 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:03.221816 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b7190ec1-a720-4828-9d0d-a23fe9c2549a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.146649 Sep 24 15:02:03.222422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 182/379] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:03 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:03.398286 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:03.398899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:03.404898 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:03.405390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:03.406472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:03.407241 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:03.407701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:03.408130 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:03.623137 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:03.631875 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:03.633322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:03.634507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-81867abb-bc05-45db-bf2a-937937b248ba tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.240382 Sep 24 15:02:03.635060 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 198/380] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:03 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:03.784470 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:03.785151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:03.791596 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:03.792087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:03.792529 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:03.793217 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:03.793682 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:03.794157 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:03.858134 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:03.866783 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2a60d3f1-e8d0-4949-b9d4-c153daa881c2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1242 microversion: 2.1 time: 0.086106 Sep 24 15:02:03.867352 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 183/381] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:03 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:04.244123 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:04.244733 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:04.250683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:04.251167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:04.251601 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:04.252286 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:04.252739 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:04.253164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:04.376968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:04.384799 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-82f32936-8b79-42bc-b2aa-d179aa893570 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.144506 Sep 24 15:02:04.385665 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 199/382] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:04 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:04.659860 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:04.660573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:04.666367 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:04.666862 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:04.667306 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:04.668004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:04.668468 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:04.668928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:04.805035 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:04.814087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:04.815571 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:04.816745 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-62c57983-82e4-4063-9074-2972a160a60e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.161445 Sep 24 15:02:04.817616 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 184/383] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:04 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:04.890877 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:04.891235 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:04.896964 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:04.897461 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:04.897938 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:04.898644 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:04.899110 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:04.899548 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:04.961528 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:04.969623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5daab935-bc9e-40e0-9274-e416398387ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1242 microversion: 2.1 time: 0.083317 Sep 24 15:02:04.970257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 200/384] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:04 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:05.411992 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:05.412660 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:05.418840 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:05.419576 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:05.420146 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:05.420936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:05.421479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:05.421965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:05.560247 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:05.568975 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8fba7328-c47d-46ed-8419-7c48183c2cd0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.163641 Sep 24 15:02:05.569663 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 185/385] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:05 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:05.843833 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:05.845469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:05.852905 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:05.853803 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:05.854438 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:05.855192 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:05.855769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:05.856230 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:05.995186 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:05.998505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:06.024814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:06.025324 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:06.025619 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:06.026104 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:06.026491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:06.028318 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:06.028944 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:06.035238 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:06.036992 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:06.038320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-88096786-6ca0-463c-a94d-4c92437f1e6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.199646 Sep 24 15:02:06.038990 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 201/386] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:05 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:06.109563 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:06.120035 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fe0e3e86-e8cf-4b44-9745-b739f06de3d8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1298 microversion: 2.1 time: 0.131342 Sep 24 15:02:06.120988 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 186/387] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:05 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:06.594457 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:06.595756 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:06.602382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:06.602889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:06.603407 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:06.604343 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:06.604892 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:06.605334 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:06.814845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:06.825866 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-097c8f9c-cfc7-475e-8a45-0fb5fdcff2e6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.235351 Sep 24 15:02:06.832834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 202/388] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:06 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:07.070175 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:07.071847 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:07.079945 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:07.080778 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:07.081491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:07.082407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:07.082970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:07.083495 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:07.145954 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:07.147150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:07.156538 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:07.158113 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:07.158993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:07.160394 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:07.161398 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:07.162315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:07.318744 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:07.322356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:07.327618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f8781f82-b3a2-49b0-b8ad-eacef8eff0a0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1304 microversion: 2.1 time: 0.187284 Sep 24 15:02:07.328511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 203/389] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:07 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:07.331335 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:07.350188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:07.351932 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:07.353297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6780e19e-d725-41df-a120-1eb7133b3f66 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.288269 Sep 24 15:02:07.354381 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 187/390] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:07 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:07.852257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:07.852810 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:07.863985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:07.866537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:07.867008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:07.867744 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:07.868213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:07.868645 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:08.358573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:08.359996 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:08.370555 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:08.372068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:08.373539 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:08.374571 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:08.375396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:08.388425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:08.525965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:08.554316 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4015d3d1-e057-4bd9-bb60-c4819fa5b6ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.693062 Sep 24 15:02:08.554993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 204/391] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:07 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:08.558356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:08.560468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:08.561314 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:08.567176 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d5f0a1cf-9718-47d4-b2aa-3e2ae2b1127e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.214272 Sep 24 15:02:08.571373 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:08.573829 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 188/392] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:08 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:08.574557 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:08.575159 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:08.575952 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:08.576608 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:08.577272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:08.833873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:08.846562 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:08.848863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:08.850358 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8111e4b7-ac80-4fb0-a9f5-c3f37ef7ec2a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.294129 Sep 24 15:02:08.851277 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 205/393] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:08 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:09.009121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4fe153f2-9b27-465c-9881-983e230b7830 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c1395b8-7310-4368-a0e8-5c79ae8d3229", "device": "/dev/sdb"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:09.012955 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4fe153f2-9b27-465c-9881-983e230b7830 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:09.020554 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4fe153f2-9b27-465c-9881-983e230b7830 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:09.021702 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4fe153f2-9b27-465c-9881-983e230b7830 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:09.022415 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4fe153f2-9b27-465c-9881-983e230b7830 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:09.023464 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4fe153f2-9b27-465c-9881-983e230b7830 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:09.024186 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4fe153f2-9b27-465c-9881-983e230b7830 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:09.024828 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4fe153f2-9b27-465c-9881-983e230b7830 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:09.092547 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-5e39b631-cb5e-48d7-b431-fa2b3fab1d6e req-8eb36157-3773-4b6b-8873-2dd42b13e31e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5", "tag": "ce05ac73-d405-4dc3-bd9f-978a3684e962"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:09.109213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-5e39b631-cb5e-48d7-b431-fa2b3fab1d6e req-8eb36157-3773-4b6b-8873-2dd42b13e31e service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:09.109710 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-5e39b631-cb5e-48d7-b431-fa2b3fab1d6e req-8eb36157-3773-4b6b-8873-2dd42b13e31e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:09.110202 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-5e39b631-cb5e-48d7-b431-fa2b3fab1d6e req-8eb36157-3773-4b6b-8873-2dd42b13e31e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:09.129145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-5e39b631-cb5e-48d7-b431-fa2b3fab1d6e req-8eb36157-3773-4b6b-8873-2dd42b13e31e service nova] Creating event network-changed:ce05ac73-d405-4dc3-bd9f-978a3684e962 for instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 on hv-cinder-85919 Sep 24 15:02:09.160217 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-5e39b631-cb5e-48d7-b431-fa2b3fab1d6e req-8eb36157-3773-4b6b-8873-2dd42b13e31e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070552 Sep 24 15:02:09.160789 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 206/394] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:02:09.474689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4fe153f2-9b27-465c-9881-983e230b7830 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "POST /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469625 Sep 24 15:02:09.476307 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 189/395] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:02:09 2022] POST /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3/os-volume_attachments => generated 194 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:02:09.579709 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:09.581249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:09.591962 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:09.592702 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:09.595278 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:09.602422 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:09.602671 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:09.603132 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:09.603861 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:09.604331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:09.604888 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:09.611211 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:09.611719 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:09.612166 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:09.612898 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:09.613377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:09.614111 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:09.800315 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:09.818627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f4e54c3d-8c7e-447b-b1cf-44a6008355c6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.231669 Sep 24 15:02:09.819791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 190/396] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:09 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:09.877863 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:09.879471 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:09.886106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:09.886606 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:09.887052 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:09.887767 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:09.888233 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:09.888671 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:09.956032 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:09.972607 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9625bc60-6cb2-44bf-a40e-a2e6697fb1e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.397713 Sep 24 15:02:09.975859 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 207/397] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:09 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:10.059977 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:10.064674 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:10.081470 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:10.083312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:10.084635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ef27dfa3-875a-4538-b8a9-d5d541b71e40 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1747 microversion: 2.20 time: 0.212015 Sep 24 15:02:10.085206 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 191/398] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:09 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1747 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:10.248127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-a6742e2e-b84f-45a5-bd1c-201700750b7b req-2c90b35e-db4d-4934-b485-fbfdba989e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e9dbe91-58e2-4672-9c57-0ad669724eed", "name": "network-vif-plugged", "status": "completed", "tag": "785318ab-a784-470a-b060-4ed1ab4ff69e"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:10.259663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a6742e2e-b84f-45a5-bd1c-201700750b7b req-2c90b35e-db4d-4934-b485-fbfdba989e5c service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:10.260527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a6742e2e-b84f-45a5-bd1c-201700750b7b req-2c90b35e-db4d-4934-b485-fbfdba989e5c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:10.261273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a6742e2e-b84f-45a5-bd1c-201700750b7b req-2c90b35e-db4d-4934-b485-fbfdba989e5c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:10.272591 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-a6742e2e-b84f-45a5-bd1c-201700750b7b req-2c90b35e-db4d-4934-b485-fbfdba989e5c service nova] Creating event network-vif-plugged:785318ab-a784-470a-b060-4ed1ab4ff69e for instance 2e9dbe91-58e2-4672-9c57-0ad669724eed on hv-cinder-85919 Sep 24 15:02:10.277855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-a6742e2e-b84f-45a5-bd1c-201700750b7b req-2c90b35e-db4d-4934-b485-fbfdba989e5c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Sep 24 15:02:10.279100 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 208/399] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:02:10.841187 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:10.841806 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:10.845634 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:10.846352 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=8 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:10.851114 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:10.851798 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:10.852567 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:10.853275 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:10.853727 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:10.854175 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:11.006485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:11.011140 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:11.016122 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=16 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:11.026464 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:11.026965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:11.027599 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:11.028326 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:11.028787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:11.029409 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:11.051269 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:11.061312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-60da03cd-43a7-4114-9f23-b23da155ff9e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.224154 Sep 24 15:02:11.061927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 192/400] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:10 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:11.111280 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:11.112167 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:11.118867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:11.119965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:11.119965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:11.120546 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:11.121024 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:11.121451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:11.192114 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:11.201744 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c9967e36-43db-4c43-ac67-2f214dfa3957 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.200931 Sep 24 15:02:11.217476 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 209/401] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:10 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:11.276143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:11.286560 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:11.288126 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:11.289295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2cd021f0-c1b6-4029-801d-c5c3ebdde202 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1747 microversion: 2.20 time: 0.181966 Sep 24 15:02:11.289857 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 193/402] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:11 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1747 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:02:12.084897 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:12.086337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:12.092468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:12.092974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:12.093423 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:12.094320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:12.094795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:12.095247 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:12.225341 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:12.226000 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:12.235764 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:12.236759 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:12.237228 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:12.238037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:12.238517 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:12.239272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:12.239614 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:12.247851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4bdc328f-a458-44b9-8427-9398ee53c9cd tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.166940 Sep 24 15:02:12.263188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 210/403] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:12 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:12.315018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:12.315944 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:12.322127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:12.322876 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:12.323498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:12.324380 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:12.325030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:12.325486 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:12.395583 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:12.404492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b0a71b48-7274-442f-915e-418b6bfd2955 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.183076 Sep 24 15:02:12.405123 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 194/404] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:12 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:12.466927 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:12.476534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:12.478302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:12.479651 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c2c1c95a-42fa-4a90-9a5f-2ad3c4b6d8cf tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1747 microversion: 2.20 time: 0.168502 Sep 24 15:02:12.480205 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 211/405] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:12 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:02:13.273589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:13.274274 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:13.281000 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:13.281490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:13.282047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:13.282755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:13.283218 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:13.283650 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:13.421731 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:13.428003 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:13.428708 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:13.435320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:13.435827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:13.436276 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:13.437136 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:13.437822 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:13.438817 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:13.440311 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-32463bca-8480-41b0-a137-f5cee9ad1d56 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.170963 Sep 24 15:02:13.440894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 195/406] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:13 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:13.508984 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:13.510537 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:13.518611 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:13.519553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:13.520572 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:13.521807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:13.523125 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:13.523754 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:13.595397 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:13.607277 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b062964c-ed97-4b2a-9981-bce5088ba1f2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1368 microversion: 2.1 time: 0.182739 Sep 24 15:02:13.609522 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 212/407] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:13 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:13.706717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:13.718547 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:13.720743 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:13.722628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-485bbbe9-5c24-48d6-a955-ac504d2827f1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1747 microversion: 2.20 time: 0.218798 Sep 24 15:02:13.725968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 196/408] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:13 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1747 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:02:14.113025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-72f6dade-07b6-4afd-969e-c2f101c8c953 req-b0ab41fd-b0e5-448c-aac8-151f04634208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b247c5c-f642-4bcf-9c60-4b993f241a74", "name": "network-vif-plugged", "status": "completed", "tag": "4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:14.126343 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-72f6dade-07b6-4afd-969e-c2f101c8c953 req-b0ab41fd-b0e5-448c-aac8-151f04634208 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:14.126968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-72f6dade-07b6-4afd-969e-c2f101c8c953 req-b0ab41fd-b0e5-448c-aac8-151f04634208 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:14.127477 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-72f6dade-07b6-4afd-969e-c2f101c8c953 req-b0ab41fd-b0e5-448c-aac8-151f04634208 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:14.139050 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-72f6dade-07b6-4afd-969e-c2f101c8c953 req-b0ab41fd-b0e5-448c-aac8-151f04634208 service nova] Creating event network-vif-plugged:4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67 for instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 on hv-cinder-85919 Sep 24 15:02:14.144551 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-72f6dade-07b6-4afd-969e-c2f101c8c953 req-b0ab41fd-b0e5-448c-aac8-151f04634208 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036316 Sep 24 15:02:14.145543 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 213/409] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:02:14.462657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:14.463313 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:14.471810 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:14.472940 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:14.473575 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:14.474783 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:14.475322 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:14.475975 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:14.624671 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:14.633587 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-681314e7-716b-460a-b2ca-3f9ae8e4883d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.174810 Sep 24 15:02:14.634651 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 197/410] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:14 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:14.635795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:14.636497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:14.643335 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:14.643859 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:14.644299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:14.645034 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:14.645494 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:14.645947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:14.752846 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:14.754140 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:14.761433 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:14.761433 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:14.762328 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:14.762981 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:14.763628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:14.764163 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:14.790372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:14.798773 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-95ec9591-8b38-47fb-b43d-a759fa628d78 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1558 microversion: 2.1 time: 0.167242 Sep 24 15:02:14.799536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 214/411] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:14 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:14.824425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d622b4c7-3229-417b-847c-8970069b294f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:14.825041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d622b4c7-3229-417b-847c-8970069b294f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:14.831814 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d622b4c7-3229-417b-847c-8970069b294f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:14.832321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d622b4c7-3229-417b-847c-8970069b294f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:14.832769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d622b4c7-3229-417b-847c-8970069b294f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:14.833498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d622b4c7-3229-417b-847c-8970069b294f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:14.833988 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d622b4c7-3229-417b-847c-8970069b294f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:14.834474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d622b4c7-3229-417b-847c-8970069b294f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:14.932621 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d622b4c7-3229-417b-847c-8970069b294f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112082 Sep 24 15:02:14.933280 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 215/412] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Sep 24 15:02:14 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:02:15.023601 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:15.033021 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:15.035154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:15.036467 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c26f4bfb-558e-423c-8727-fde9a702d97f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.291281 Sep 24 15:02:15.037110 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 198/413] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:14 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:02:15.658420 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:15.658954 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:15.665025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:15.665525 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:15.666003 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:15.666918 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:15.667553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:15.667989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:15.819806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:15.828676 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7df6a5fe-b023-4326-bee2-dac444bba5c7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.174084 Sep 24 15:02:15.844078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 216/414] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:15 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:16.061623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:16.062900 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:16.069505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:16.070027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:16.070672 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:16.071549 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:16.072176 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:16.072776 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:16.354851 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:16.362953 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:16.364663 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:16.365949 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b55bff31-999d-4112-912f-a569a78a45e6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.308321 Sep 24 15:02:16.366509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 199/415] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:16 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:16.547962 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-55f0d6e4-ef32-4bd6-80ab-bf9d702676a7 req-20746cbe-827f-4b46-b5d5-dce8026139ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e9dbe91-58e2-4672-9c57-0ad669724eed", "tag": "785318ab-a784-470a-b060-4ed1ab4ff69e"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:16.561691 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-55f0d6e4-ef32-4bd6-80ab-bf9d702676a7 req-20746cbe-827f-4b46-b5d5-dce8026139ab service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:16.562529 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-55f0d6e4-ef32-4bd6-80ab-bf9d702676a7 req-20746cbe-827f-4b46-b5d5-dce8026139ab service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:16.563702 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-55f0d6e4-ef32-4bd6-80ab-bf9d702676a7 req-20746cbe-827f-4b46-b5d5-dce8026139ab service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:16.576572 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-55f0d6e4-ef32-4bd6-80ab-bf9d702676a7 req-20746cbe-827f-4b46-b5d5-dce8026139ab service nova] Creating event network-changed:785318ab-a784-470a-b060-4ed1ab4ff69e for instance 2e9dbe91-58e2-4672-9c57-0ad669724eed on hv-cinder-85919 Sep 24 15:02:16.582969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-55f0d6e4-ef32-4bd6-80ab-bf9d702676a7 req-20746cbe-827f-4b46-b5d5-dce8026139ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039211 Sep 24 15:02:16.583791 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 217/416] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:02:16.851457 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:16.852076 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:16.857988 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:16.858482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:16.858928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:16.859629 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:16.860133 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:16.860566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:17.072020 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:17.148627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f6b940e9-724a-4774-ba65-6cff9618f9ac tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.299572 Sep 24 15:02:17.149267 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 200/417] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:16 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:17.392740 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:17.393514 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:17.400225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:17.401751 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:17.403228 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:17.404513 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:17.405192 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:17.405827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:17.665473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:17.685865 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:17.687884 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:17.689281 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-960c8526-c189-4f87-ab83-2d761bd05d4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.301504 Sep 24 15:02:17.690344 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 218/418] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:17 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:18.178389 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:18.179664 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:18.194294 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:18.195053 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:18.195680 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:18.196589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:18.199442 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:18.200107 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:18.515966 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:18.525324 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fd65371f-7c78-421f-b3ae-53fef1ff0c5d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.351032 Sep 24 15:02:18.547757 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 201/419] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:18 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:18.718955 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:18.719741 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:18.728416 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:18.728921 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:18.729350 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:18.730091 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:18.730550 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:18.730976 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:19.142737 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:19.152841 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:19.162443 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:19.167887 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7bab8e2c-1580-4a95-a7cd-c0c4cadc04cc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.452775 Sep 24 15:02:19.169337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 219/420] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:18 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:19.561317 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:19.563574 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:19.571215 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:19.572073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:19.575314 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:19.576912 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:19.577666 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:19.578373 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:19.765689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:19.776502 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6f5ca763-fbbe-4d4b-9b9f-ec9ab2687338 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.219633 Sep 24 15:02:19.793894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 202/421] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:19 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:20.200702 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:20.202589 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:20.211542 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:20.212320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:20.212928 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:20.213809 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:20.214458 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:20.215041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:20.449002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:20.459482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:20.461068 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:20.469636 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2e06aa7d-7cef-4fbb-a65b-1f39d20c319a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.268037 Sep 24 15:02:20.470858 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 220/422] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:20 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:20.803429 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:20.804047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:20.811913 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:20.815790 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:20.816254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:20.819859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:20.820405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:20.820886 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:20.975390 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:20.983950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-adddd36c-f18c-4a13-a7ee-05ed36cefad0 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.184486 Sep 24 15:02:20.997921 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 203/423] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:20 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:21.496461 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:21.497754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:21.504453 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:21.504940 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:21.505553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:21.506290 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:21.506745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:21.507197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:21.652094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:21.661867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:21.663371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:21.664705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e00e07ed-83fb-4901-9609-45ef73d3c41c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.172147 Sep 24 15:02:21.665591 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 221/424] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:21 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:22.008803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:22.010261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:22.017318 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:22.018066 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:22.018699 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:22.019640 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:22.020292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:22.020730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:22.158870 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:22.166902 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f42510ef-c864-4cb5-87fe-825ea40ab215 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.162101 Sep 24 15:02:22.167709 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 204/425] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:22 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:22.690390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:22.691007 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:22.696073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:22.697814 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:22.709736 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:22.710345 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:22.711399 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:22.712039 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:22.712469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:22.973145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:22.996828 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:23.003368 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:23.007555 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-776b04ca-9269-4ebc-9d6c-58fbcd0fc7a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.320588 Sep 24 15:02:23.023116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 222/426] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:22 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:23.190680 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:23.192209 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:23.208454 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:23.209472 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:23.210429 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:23.211451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:23.212334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:23.213091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:23.413057 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:23.430069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1620708e-c0ff-4cf5-a080-a218b7679948 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.244284 Sep 24 15:02:23.448149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 205/427] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:23 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:24.038412 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:24.039106 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:24.051759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:24.052264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:24.052701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:24.053416 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:24.053878 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:24.054721 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:24.093066 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:24.323306 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:24.340157 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:24.342277 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:24.347782 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c4f981a1-9110-4be5-beb8-317a3cd22d8e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.314868 Sep 24 15:02:24.350203 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 223/428] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:24 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:24.467378 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:24.469782 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:24.480456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:24.483277 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:24.483993 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:24.486410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:24.487118 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:24.487858 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:24.692162 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:24.702995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4da1d47e-854e-4212-9463-7d73ac329890 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.253699 Sep 24 15:02:24.724047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 206/429] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:24 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:25.135064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-75c36372-5614-449d-adb0-75fd5693e0cb req-86cec24c-ebdf-4d18-96ce-b75e30035e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5", "name": "network-vif-plugged", "status": "completed", "tag": "ce05ac73-d405-4dc3-bd9f-978a3684e962"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:25.162145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-75c36372-5614-449d-adb0-75fd5693e0cb req-86cec24c-ebdf-4d18-96ce-b75e30035e99 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:25.162749 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-75c36372-5614-449d-adb0-75fd5693e0cb req-86cec24c-ebdf-4d18-96ce-b75e30035e99 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:25.163219 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-75c36372-5614-449d-adb0-75fd5693e0cb req-86cec24c-ebdf-4d18-96ce-b75e30035e99 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:25.210381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-75c36372-5614-449d-adb0-75fd5693e0cb req-86cec24c-ebdf-4d18-96ce-b75e30035e99 service nova] Creating event network-vif-plugged:ce05ac73-d405-4dc3-bd9f-978a3684e962 for instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 on hv-cinder-85919 Sep 24 15:02:25.228411 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-75c36372-5614-449d-adb0-75fd5693e0cb req-86cec24c-ebdf-4d18-96ce-b75e30035e99 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097327 Sep 24 15:02:25.232076 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 224/430] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:02:25.378273 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:25.379513 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:25.394357 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:25.395322 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:25.398546 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:25.399775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:25.400473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:25.403658 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:25.595617 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:25.606740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:25.609417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:25.612308 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c5ced727-0020-4c45-93c3-a5e249a11b7f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.239389 Sep 24 15:02:25.644135 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 207/431] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:25 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:25.733814 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:25.735524 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:25.743227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:25.744071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:25.744704 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:25.745586 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:25.746346 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:25.746940 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:25.932128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:25.941073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9023ba9d-292f-4e54-827e-5d40bf933f55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.212746 Sep 24 15:02:25.943406 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 225/432] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:25 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:26.661027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:26.661664 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:26.671725 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:26.673155 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:26.673666 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:26.674938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:26.675624 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:26.676304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:26.725092 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:26.912046 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:26.927480 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:26.931063 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:26.934111 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f98d267e-83f9-4892-9ce3-1c6c8cde8531 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.291925 Sep 24 15:02:26.935868 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 208/433] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:26 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:26.973395 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:26.976463 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:26.988331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:26.990322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:26.991345 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:26.992711 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:26.993374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:26.994028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:27.203081 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:27.217045 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-da749b16-1239-4dd8-865b-ad47ee08b280 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.252386 Sep 24 15:02:27.231213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 226/434] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:26 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:27.990912 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:28.001814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:28.036716 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:28.038018 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:28.040064 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:28.042867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:28.044385 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:28.045439 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:28.246209 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:28.246925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:28.257965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:28.259431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:28.259956 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:28.261665 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:28.262319 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:28.262853 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:28.311210 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:28.324531 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:28.325371 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:28.326704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-303d0ee9-4091-4195-a626-835d1d691a24 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.369951 Sep 24 15:02:28.338720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 209/435] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:27 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:28.496442 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:28.506088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4bcee83e-1a27-44c4-8c9c-4170e334b54d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.264599 Sep 24 15:02:28.519306 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 227/436] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:28 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:29.352668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:29.353431 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:29.360319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:29.360810 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:29.361257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:29.361993 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:29.362462 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:29.362897 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:29.488036 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:29.496724 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:29.498254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:29.499732 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e7f1f722-2033-45fe-a380-f81432f02fc2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.150723 Sep 24 15:02:29.500256 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 210/437] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:29 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:29.530626 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:29.531241 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:29.537589 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:29.538115 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:29.538560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:29.539253 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:29.539715 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:29.540144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:29.667692 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:29.676285 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1f395f03-2ec2-465f-8364-97e6e67cd408 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.149448 Sep 24 15:02:29.679131 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 228/438] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:29 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:30.523826 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:30.524445 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:30.530868 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:30.531380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:30.531825 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:30.532521 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:30.532984 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:30.533415 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:30.667670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:30.676263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:30.677723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:30.678937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-912e214e-9337-461c-9fae-42d48054a68b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.158960 Sep 24 15:02:30.679516 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 211/439] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:30 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:30.698536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:30.699151 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:30.705011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:30.705527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:30.705999 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:30.706705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:30.707166 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:30.707613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:30.832447 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:30.840035 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6f04afac-fcad-4531-a06e-1f30a3aee300 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.145299 Sep 24 15:02:30.840600 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 229/440] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:30 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:31.705078 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:31.705709 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:31.712704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:31.713231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:31.713847 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:31.714752 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:31.715226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:31.715665 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:31.864278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:31.865794 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:31.872414 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:31.875980 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:31.879834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:31.882825 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:31.886641 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:31.887204 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:31.887523 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:31.887972 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:31.890349 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:31.896792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5e6fbe70-4227-4884-a474-b2cf9afec535 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.195642 Sep 24 15:02:31.897611 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 212/441] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:31 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:32.060244 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:32.068806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-438f08e7-f0e5-4895-bd46-25d2ec238d43 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.210001 Sep 24 15:02:32.069548 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 230/442] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:31 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:32.930323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:32.931719 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:32.939456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:32.939964 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:32.940408 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:32.941180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:32.941669 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:32.942154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:33.095226 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:33.095847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:33.104786 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:33.105603 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:33.106242 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:33.107175 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:33.107854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:33.108661 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:33.133541 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:33.140296 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:33.142386 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:33.143734 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c35eee49-3f01-4299-bca8-5eb8eca9bd62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1742 microversion: 2.20 time: 0.217867 Sep 24 15:02:33.158358 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 213/443] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:32 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1742 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:33.282282 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:33.291026 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1d82ab3a-1634-4bb1-bbfd-0b7430bd17d4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1371 microversion: 2.1 time: 0.200141 Sep 24 15:02:33.291707 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 231/444] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:33 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:34.170193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:34.171339 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:34.177678 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:34.178224 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:34.178887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:34.180037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:34.180598 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:34.180928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:34.313953 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:34.315119 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:34.321052 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:34.321546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:34.322011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:34.322909 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:34.323365 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:34.324014 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:34.326514 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:34.335806 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:34.337273 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:34.338481 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8f4ac0d7-56f6-4ab1-9939-6307ce443837 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1724 microversion: 2.20 time: 0.172326 Sep 24 15:02:34.346632 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 214/445] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:34 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:34.583833 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:34.593211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e704e0be-8139-4787-8c63-0a91f2560b5f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1565 microversion: 2.1 time: 0.282732 Sep 24 15:02:34.594518 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 232/446] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:34 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1565 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:34.629512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a1e1ed9f-9bd7-46e5-a5d5-109af4e1361f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:34.629512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a1e1ed9f-9bd7-46e5-a5d5-109af4e1361f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:34.629512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1e1ed9f-9bd7-46e5-a5d5-109af4e1361f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:34.629512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1e1ed9f-9bd7-46e5-a5d5-109af4e1361f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:34.629842 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1e1ed9f-9bd7-46e5-a5d5-109af4e1361f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:34.629842 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1e1ed9f-9bd7-46e5-a5d5-109af4e1361f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:34.630018 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1e1ed9f-9bd7-46e5-a5d5-109af4e1361f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:34.630503 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a1e1ed9f-9bd7-46e5-a5d5-109af4e1361f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:34.717127 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a1e1ed9f-9bd7-46e5-a5d5-109af4e1361f tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103601 Sep 24 15:02:34.717729 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 215/447] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Sep 24 15:02:34 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:02:35.363793 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:35.364674 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:35.370578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:35.371071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:35.371513 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:35.372203 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:35.372664 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:35.373091 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:35.513241 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:35.521537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:35.523243 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:35.524607 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b7b21914-aae9-4d3c-bf55-e51bcf0635d0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1724 microversion: 2.20 time: 0.164680 Sep 24 15:02:35.525182 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 233/448] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:35 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:35.877792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-583c3a8f-53d7-45e6-a81e-7233e1a2b9f0 req-3288cbf1-22ef-4c3a-b432-88b837d63edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5", "tag": "ce05ac73-d405-4dc3-bd9f-978a3684e962"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:35.887485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-583c3a8f-53d7-45e6-a81e-7233e1a2b9f0 req-3288cbf1-22ef-4c3a-b432-88b837d63edd service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:35.887986 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-583c3a8f-53d7-45e6-a81e-7233e1a2b9f0 req-3288cbf1-22ef-4c3a-b432-88b837d63edd service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:35.888430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-583c3a8f-53d7-45e6-a81e-7233e1a2b9f0 req-3288cbf1-22ef-4c3a-b432-88b837d63edd service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:35.902177 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-583c3a8f-53d7-45e6-a81e-7233e1a2b9f0 req-3288cbf1-22ef-4c3a-b432-88b837d63edd service nova] Creating event network-changed:ce05ac73-d405-4dc3-bd9f-978a3684e962 for instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 on hv-cinder-85919 Sep 24 15:02:35.909520 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-583c3a8f-53d7-45e6-a81e-7233e1a2b9f0 req-3288cbf1-22ef-4c3a-b432-88b837d63edd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036199 Sep 24 15:02:35.910414 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 216/449] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:02:36.419865 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:36.421062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:36.429447 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:36.430449 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:36.430983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:36.431917 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:36.432582 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:36.433346 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:36.553636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:36.554721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:36.567881 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:36.569105 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:36.569606 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:36.570745 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:36.571211 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:36.571652 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:36.603079 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lazy-loading 'services' on Instance uuid 7609461c-58d1-45fe-9990-b0d1536f8ab3 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:02:36.774839 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d023e0d9-3263-4c4b-8f8c-6faafa341fc4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3/os-volume_attachments/0c1395b8-7310-4368-a0e8-5c79ae8d3229" status: 202 len: 0 microversion: 2.1 time: 0.360767 Sep 24 15:02:36.789605 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:36.793103 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 234/450] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:02:36 2022] DELETE /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3/os-volume_attachments/0c1395b8-7310-4368-a0e8-5c79ae8d3229 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:02:36.803168 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:36.810306 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:36.811674 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-54237cc1-c697-4a02-9855-585c4316ef05 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1724 microversion: 2.20 time: 0.265955 Sep 24 15:02:36.813385 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 217/451] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:36 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:36.867002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-f367c74b-a641-434a-9b9b-d70a1630cd78 req-34dda4b7-26fd-4ebe-adcf-5ea0c7c90e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b247c5c-f642-4bcf-9c60-4b993f241a74", "name": "network-vif-unplugged", "status": "completed", "tag": "4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:36.896765 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-f367c74b-a641-434a-9b9b-d70a1630cd78 req-34dda4b7-26fd-4ebe-adcf-5ea0c7c90e75 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:36.897563 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-f367c74b-a641-434a-9b9b-d70a1630cd78 req-34dda4b7-26fd-4ebe-adcf-5ea0c7c90e75 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:36.898236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-f367c74b-a641-434a-9b9b-d70a1630cd78 req-34dda4b7-26fd-4ebe-adcf-5ea0c7c90e75 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:36.911063 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-f367c74b-a641-434a-9b9b-d70a1630cd78 req-34dda4b7-26fd-4ebe-adcf-5ea0c7c90e75 service nova] Creating event network-vif-unplugged:4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67 for instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 on hv-cinder-85919 Sep 24 15:02:36.918771 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-f367c74b-a641-434a-9b9b-d70a1630cd78 req-34dda4b7-26fd-4ebe-adcf-5ea0c7c90e75 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057125 Sep 24 15:02:36.920101 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 235/452] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:02:37.838623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:37.839273 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:37.845989 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:37.846490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:37.846938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:37.847791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:37.848262 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:37.848698 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:38.010473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:38.021026 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:38.023010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:38.024180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-000ba2b1-8021-4548-8ce2-13f43ca64b00 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1727 microversion: 2.20 time: 0.189549 Sep 24 15:02:38.024924 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 218/453] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:37 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:38.051359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-99b23481-e9ff-44eb-966e-100e90321985 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "627fa28b-b069-4d1b-8bd6-7aea8b1f1d52"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:38.055050 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-99b23481-e9ff-44eb-966e-100e90321985 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:38.061739 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-99b23481-e9ff-44eb-966e-100e90321985 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:38.062274 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-99b23481-e9ff-44eb-966e-100e90321985 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:38.063610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-99b23481-e9ff-44eb-966e-100e90321985 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:38.064354 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-99b23481-e9ff-44eb-966e-100e90321985 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:38.065338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-99b23481-e9ff-44eb-966e-100e90321985 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:38.065672 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-99b23481-e9ff-44eb-966e-100e90321985 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:38.591064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-99b23481-e9ff-44eb-966e-100e90321985 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.539728 Sep 24 15:02:38.592872 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 236/454] 10.222.0.61 () {62 vars in 1364 bytes} [Sat Sep 24 15:02:38 2022] POST /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments => generated 188 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 15:02:38.777667 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:38.778290 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:38.784866 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:38.785363 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:38.785974 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:38.786682 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:38.787261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:38.787732 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:38.832765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120591) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 15:02:38.909881 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-727a12ad-cb36-49d5-8373-fb586247b07d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/action" status: 202 len: 0 microversion: 2.20 time: 0.134610 Sep 24 15:02:38.910455 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 219/455] 10.222.0.61 () {62 vars in 1319 bytes} [Sat Sep 24 15:02:38 2022] POST /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:02:38.923603 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:38.924491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:38.933986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:38.935521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:38.940528 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:38.941525 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:38.942160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:38.942824 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:39.086260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:39.087245 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:39.095516 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:39.096291 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:39.096992 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:39.098061 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:39.098722 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:39.099647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:39.152739 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:02:39.265184 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f8b3cad8-db08-4bdb-ad46-38f46e76e0cc tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 204 len: 0 microversion: 2.1 time: 0.182698 Sep 24 15:02:39.266394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 220/456] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:02:39 2022] DELETE /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:02:39.275300 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:39.276002 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:39.283297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:39.284783 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:39.285399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:39.286299 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:39.286917 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:39.287531 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:39.321488 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:39.331733 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:39.333311 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:39.334714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-65043f3e-5f9d-454e-871e-fcafe99f27f2 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1813 microversion: 2.20 time: 0.419109 Sep 24 15:02:39.335621 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 237/457] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:38 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1813 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:39.448129 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:39.458558 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-089e7a62-f347-4940-bdf6-783e6c025a3c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1514 microversion: 2.1 time: 0.187318 Sep 24 15:02:39.459339 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 221/458] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:39 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:40.362584 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:40.363201 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:40.370959 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:40.371844 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:40.372339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:40.373072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:40.373537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:40.374494 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:40.392300 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:40.483897 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:40.485182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:40.488316 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:40.495584 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:40.496369 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:40.497151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:40.497890 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:40.498581 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:40.499059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:40.644848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:40.669366 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-caf1a910-a1e9-40cb-a708-a637ebe1c46c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1514 microversion: 2.1 time: 0.189976 Sep 24 15:02:40.669984 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 222/459] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:40 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:40.889809 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:40.900759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:40.903224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:40.903974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fb376fd8-eb15-4feb-9a19-10f145975e70 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1753 microversion: 2.20 time: 0.545706 Sep 24 15:02:40.912138 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 238/460] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:40 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1753 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:41.692751 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:41.693376 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:41.701290 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:41.701803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:41.702271 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:41.703040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:41.703504 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:41.703937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:41.724508 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:41.848276 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:41.856706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a2ce20d4-ff60-4f6f-ab6b-07014d445e6b tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1514 microversion: 2.1 time: 0.168114 Sep 24 15:02:41.863646 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 223/461] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:41 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:41.936707 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:41.938361 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:41.947316 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:41.948030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:41.948469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:41.949363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:41.950275 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:41.951010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:42.275886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:42.287840 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:42.289565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:42.290859 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2ee8997d-0fae-415c-9c71-00bcaa954afa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1755 microversion: 2.20 time: 0.362098 Sep 24 15:02:42.291427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 239/462] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:41 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1755 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:42.829152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-7ee4ab23-a04e-4dfe-88c1-26dbf6870c14 req-5e6e29e6-84cb-4110-9179-556b81555dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7609461c-58d1-45fe-9990-b0d1536f8ab3", "name": "network-vif-deleted", "tag": "249a77ef-d91f-4f03-aa48-4803c0645130"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:42.848826 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-7ee4ab23-a04e-4dfe-88c1-26dbf6870c14 req-5e6e29e6-84cb-4110-9179-556b81555dc5 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:42.849310 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-7ee4ab23-a04e-4dfe-88c1-26dbf6870c14 req-5e6e29e6-84cb-4110-9179-556b81555dc5 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:42.854506 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-7ee4ab23-a04e-4dfe-88c1-26dbf6870c14 req-5e6e29e6-84cb-4110-9179-556b81555dc5 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:42.879006 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-7ee4ab23-a04e-4dfe-88c1-26dbf6870c14 req-5e6e29e6-84cb-4110-9179-556b81555dc5 service nova] Creating event network-vif-deleted:249a77ef-d91f-4f03-aa48-4803c0645130 for instance 7609461c-58d1-45fe-9990-b0d1536f8ab3 on hv-cinder-85919 Sep 24 15:02:42.880665 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:42.881290 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:42.887309 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-7ee4ab23-a04e-4dfe-88c1-26dbf6870c14 req-5e6e29e6-84cb-4110-9179-556b81555dc5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062447 Sep 24 15:02:42.888462 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 224/463] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:02:42.893448 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:42.894129 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:42.894578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:42.895328 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:42.895797 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:42.896235 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:43.041196 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:43.055181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2a464733-631f-46b0-9117-5344146d27a2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1303 microversion: 2.1 time: 0.178160 Sep 24 15:02:43.056371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 240/464] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:42 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1303 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:02:43.317479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:43.318216 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:43.328799 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:43.329291 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:43.330627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:43.331485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:43.332260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:43.332715 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:43.517013 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:43.526937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:43.528864 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:43.530311 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-af6d12dc-5ade-42b5-a52a-e2a1fb1441f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.217275 Sep 24 15:02:43.531921 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 225/465] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:43 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:44.081035 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:44.081676 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:44.090860 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:44.091368 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:44.091816 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:44.092537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:44.093000 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:44.093437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:44.146955 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:44.147489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:44.147904 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:44.148373 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lazy-loading 'fault' on Instance uuid 7609461c-58d1-45fe-9990-b0d1536f8ab3 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:02:44.248011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:44.261553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-04351c51-bec4-4086-913a-6eb1cfd319d0 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 200 len: 1308 microversion: 2.1 time: 0.187312 Sep 24 15:02:44.262283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 241/466] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:44 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:44.561696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:44.562981 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:44.570377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:44.570911 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:44.571361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:44.572085 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:44.572579 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:44.573019 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:44.778891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:44.797016 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:44.798512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:44.799881 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dbfe43cf-6f8d-4862-ae5c-3638b831d39d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.246451 Sep 24 15:02:44.800936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 226/467] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:44 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:45.286146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:45.286589 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: 7609461c-58d1-45fe-9990-b0d1536f8ab3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:45.292906 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:45.293402 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:45.300174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:45.300991 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:45.301502 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:45.301972 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:45.336903 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] HTTP exception thrown: Instance 7609461c-58d1-45fe-9990-b0d1536f8ab3 could not be found. Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Request method failure captured: Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 HTTP/1.1 Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxvCvX1mfTF3f5E8DQIvy1efDPALSXSG_uShb9n_tJw7WBT2nAvgmpmDD7i1auOUgC6NcvZJvCXDPxvts-YutsjNrlXwbt70AS3QCzBySWOFlscxPaNgpuiYxlEVFnhdpLXp07LV5ioMNvnJ0HPRI4Jq-eB18ctJpy4UiCI3Ql3XMfo Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 5e00eaec5c3a4b53b9e39346e792da01 Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1578941610 Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:02:45.338617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5e00eaec5c3a4b53b9e39346e792da01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5e00eaec5c3a4b53b9e39346e792da01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5e00eaec5c3a4b53b9e39346e792da01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5e00eaec5c3a4b53b9e39346e792da01"}]}] Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-VolumesSnapshotTestJSON-1578941610 Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 5e00eaec5c3a4b53b9e39346e792da01 Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1578941610 Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-VolumesSnapshotTestJSON-1578941610-project Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 482233dae68d487ca9b2ff6c69684663 Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-VolumesSnapshotTestJSON-1578941610-project Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 7609461c-58d1-45fe-9990-b0d1536f8ab3 could not be found. Sep 24 15:02:45.340181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '7609461c-58d1-45fe-9990-b0d1536f8ab3'} Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7609461c-58d1-45fe-9990-b0d1536f8ab3 could not be found. Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:02:45.340968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7609461c-58d1-45fe-9990-b0d1536f8ab3 could not be found. Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7609461c-58d1-45fe-9990-b0d1536f8ab3 could not be found. Sep 24 15:02:45.342827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:02:45.346323 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Returning 404 to user: Instance 7609461c-58d1-45fe-9990-b0d1536f8ab3 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:02:45.347632 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1f99f681-ec07-409e-aed4-da7b7493569d tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3" status: 404 len: 111 microversion: 2.1 time: 0.065506 Sep 24 15:02:45.348731 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 242/468] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:45 2022] GET /compute/v2.1/servers/7609461c-58d1-45fe-9990-b0d1536f8ab3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:02:45.826318 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:45.827145 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:45.834218 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:45.834916 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:45.835451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:45.836473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:45.837142 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:45.837785 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:46.029402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:46.043766 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:46.050068 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:46.053230 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c76f7531-bcfc-4075-b10a-fac1836050b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.231114 Sep 24 15:02:46.064493 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 227/469] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:45 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:47.082861 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:47.083625 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:47.091755 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:47.094747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:47.095623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:47.096673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:47.097474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:47.098487 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:47.379432 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:47.411011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:47.417232 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:47.419434 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fd3231f6-b45b-42f0-a054-2b83947ba628 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.341456 Sep 24 15:02:47.420219 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 243/470] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:47 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:48.444355 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:48.445558 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:48.452665 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:48.454092 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:48.454705 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:48.455581 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:48.456201 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:48.456788 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:48.742684 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:48.753576 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:48.755444 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:48.756888 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-64da3845-27e2-4b8b-84a9-9f1b8fafd1f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.316525 Sep 24 15:02:48.776216 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 228/471] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:48 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:49.784079 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:49.784973 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:49.804546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:49.805078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:49.805537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:49.809997 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:49.810611 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:49.811041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:50.204054 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:50.213852 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:50.216724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:50.218239 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-01a5c963-0b9a-4882-8eef-5cb4593c3309 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.438616 Sep 24 15:02:50.237477 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 244/472] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:49 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:51.244497 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:51.245638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:51.263021 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:51.266027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:51.266498 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:51.268459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:51.270042 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:51.271148 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:51.673762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:51.684333 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:51.692142 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:51.693483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6289f53d-5095-42a8-a7a7-4d450f12b2d9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.452826 Sep 24 15:02:51.714907 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 229/473] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:51 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:52.726170 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:52.726918 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:52.734216 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:52.734834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:52.735371 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:52.736371 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:52.736943 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:52.737630 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:53.010144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7a4c8dc2-6ce4-4e3a-883b-35986446de91 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Action: 'create', calling method: .version_select at 0x7f7c10c06d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1433808875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+wz161XxE3RVTfJyI+sftmDmd0+r1/CyRsAgTs+UusqSq4qlGnkKDh51J31U3boowYCfLWgrFIrM+XbgcNjgdMl7QF/QMYuYV2G+BZeNEuqTt/EO7vvzQROW3vq5AL8A=="}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:53.027313 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=48 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:02:53.053327 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-7a4c8dc2-6ce4-4e3a-883b-35986446de91 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Getting quotas for project 43e1ec63be6740fa9516a2e5331986a2. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:02:53.063988 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-7a4c8dc2-6ce4-4e3a-883b-35986446de91 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Getting quotas for user c8a3f8bef9f0431eac090f8a520f744b and project 43e1ec63be6740fa9516a2e5331986a2. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:02:53.120888 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7a4c8dc2-6ce4-4e3a-883b-35986446de91 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.469429 Sep 24 15:02:53.122660 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 245/474] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:02:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:02:53.152393 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:53.168713 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:53.172972 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:53.178856 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-61ff7e8a-053c-4bc6-b04a-0a14aa8fd978 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.456454 Sep 24 15:02:53.183921 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 230/475] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:52 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:02:54.225410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:54.226202 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:54.232505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:54.233118 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:54.233980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:54.235377 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:54.235932 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:54.236493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:54.418028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:54.446486 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:54.448220 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:54.450091 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-862ab180-30e8-4360-9bec-0ae3b1da254e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.228558 Sep 24 15:02:54.458301 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 246/476] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:54 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:55.481755 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:55.490866 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:55.519043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:55.520260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:55.521022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:55.522483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:55.523367 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:55.524092 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:55.770432 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:55.790182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:55.794409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:55.807301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e8a52171-762c-4a06-aaf4-0dc44fce80af tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.329380 Sep 24 15:02:55.807901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 231/477] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:55 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:02:55.870889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-351647346", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "networks": [{"uuid": "6a2fe50c-7d1e-4f1b-a34b-7d142d89f8d7"}]}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:02:56.843232 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:56.844803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:56.860882 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:56.861386 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:56.861837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:56.862596 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:56.863775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:56.864482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:57.111399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:57.134279 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:57.134279 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:57.135876 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b0f69688-b275-4d81-95e7-4e47a5bfa080 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.304997 Sep 24 15:02:57.148048 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 232/478] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:56 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:02:57.720663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] validate_networks() for [('6a2fe50c-7d1e-4f1b-a34b-7d142d89f8d7', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:02:58.085972 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:02:58.086406 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:02:58.086887 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:02:58.087303 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:02:58.087723 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:02:58.096849 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:58.097339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:58.097783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:58.098562 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:58.099031 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:58.099470 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:58.117793 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Getting quotas for project 5e00eaec5c3a4b53b9e39346e792da01. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:02:58.122540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Getting quotas for user 482233dae68d487ca9b2ff6c69684663 and project 5e00eaec5c3a4b53b9e39346e792da01. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:02:58.134481 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:02:58.136862 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:02:58.168739 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:58.169739 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:58.178726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:58.179287 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:58.179881 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:58.180721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:58.181256 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:58.181744 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:58.189371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4aec555c-77d7-47dd-824e-9857861631bb tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.322953 Sep 24 15:02:58.196477 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 247/479] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:02:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:02:58.203370 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0f884bac-ba44-41ca-9cf0-35ae2bad490a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:58.204266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0f884bac-ba44-41ca-9cf0-35ae2bad490a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:58.289656 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0f884bac-ba44-41ca-9cf0-35ae2bad490a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:58.298619 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0f884bac-ba44-41ca-9cf0-35ae2bad490a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1218 microversion: 2.1 time: 0.100728 Sep 24 15:02:58.299463 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 248/480] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:58 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:58.365926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:58.375066 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:58.376512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:58.377683 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e23e4a07-0835-4361-9de6-3c2e93879958 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.214185 Sep 24 15:02:58.378290 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 233/481] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:58 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:02:59.320692 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:59.321315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:59.328071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:59.328585 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:59.329035 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:59.329749 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:59.330340 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:59.330771 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:59.395384 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:59.403424 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-eaa0c005-af11-4468-a193-529cbc8a1e83 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1270 microversion: 2.1 time: 0.086578 Sep 24 15:02:59.403983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 249/482] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:02:59 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:02:59.404213 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:02:59.405009 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:02:59.412309 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:59.412800 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:59.413236 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:59.414152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:02:59.414618 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:02:59.415049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:02:59.546965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:59.555638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:59.557085 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:02:59.558266 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-008791db-678e-4818-9e9e-c089ff87f8c6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.157990 Sep 24 15:02:59.558827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 234/483] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:02:59 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:00.428554 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:00.429240 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:00.435328 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:00.435841 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:00.436289 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:00.437016 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:00.437467 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:00.438072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:00.537125 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:00.548914 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b422a543-04e9-47f4-8768-2ecef7ebec2c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1276 microversion: 2.1 time: 0.124145 Sep 24 15:03:00.554181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 250/484] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:00 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:00.584487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:00.585261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:00.592553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:00.593804 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:00.594128 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:00.594876 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:00.595330 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:00.595756 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:00.974665 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:00.984304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:00.985969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:00.987147 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0f84c3d7-0ccf-49f0-bd5c-beac6cc55834 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.406567 Sep 24 15:03:00.987717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 235/485] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:00 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:01.572377 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:01.573035 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:01.584414 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:01.584917 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:01.585364 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:01.586121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:01.586588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:01.587022 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:01.792409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-dd4bed18-f127-4949-8a49-dfae93bebc7a req-dd9ca5b0-5509-498d-a175-0a4c1783c378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19f67b4-8d76-4f55-b9d8-5d138a544c18", "tag": "b632a1f7-1eee-4b21-9418-8b21faf2f31e"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:01.792916 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:01.801800 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e41f05fa-c8d0-4fe4-bc34-b5a865490a88 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1318 microversion: 2.1 time: 0.233245 Sep 24 15:03:01.805939 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 251/486] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:01 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:01.806104 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dd4bed18-f127-4949-8a49-dfae93bebc7a req-dd9ca5b0-5509-498d-a175-0a4c1783c378 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:01.806104 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dd4bed18-f127-4949-8a49-dfae93bebc7a req-dd9ca5b0-5509-498d-a175-0a4c1783c378 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:01.806104 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dd4bed18-f127-4949-8a49-dfae93bebc7a req-dd9ca5b0-5509-498d-a175-0a4c1783c378 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:01.820603 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-dd4bed18-f127-4949-8a49-dfae93bebc7a req-dd9ca5b0-5509-498d-a175-0a4c1783c378 service nova] Creating event network-changed:b632a1f7-1eee-4b21-9418-8b21faf2f31e for instance e19f67b4-8d76-4f55-b9d8-5d138a544c18 on hv-cinder-85919 Sep 24 15:03:01.829358 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-dd4bed18-f127-4949-8a49-dfae93bebc7a req-dd9ca5b0-5509-498d-a175-0a4c1783c378 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041587 Sep 24 15:03:01.830000 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 236/487] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:03:02.012464 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:02.013085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:02.020071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:02.020570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:02.021671 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:02.022572 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:02.023218 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:02.023689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:02.241419 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:02.250111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:02.251517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:02.252705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-98c656a0-3875-427b-aa10-5c299949de5f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.244179 Sep 24 15:03:02.253272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 252/488] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:02 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:02.825959 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:02.826633 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:02.833422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:02.833942 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:02.834398 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:02.835107 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:02.835573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:02.836008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:02.972377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:02.982224 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e7b664d0-8c07-43f2-afec-3761feb4f303 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1318 microversion: 2.1 time: 0.159416 Sep 24 15:03:02.982989 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 237/489] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:02 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:03.278916 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:03.279523 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:03.285963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:03.286452 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:03.286890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:03.287578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:03.288033 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:03.288460 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:03.422224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:03.430740 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:03.432184 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:03.433421 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5cbc5841-105e-4ac2-86e3-2717dbb4aed1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.158390 Sep 24 15:03:03.434195 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 253/490] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:03 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:04.006225 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:04.006827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:04.013265 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:04.013981 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:04.014456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:04.015814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:04.016303 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:04.016733 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:04.148365 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:04.156188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b0b7d7e3-2c60-43e1-b993-2eb288dc8d27 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1318 microversion: 2.1 time: 0.153823 Sep 24 15:03:04.156767 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 238/491] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:04 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:04.458560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:04.459174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:04.465015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:04.465496 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:04.465951 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:04.466637 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:04.467092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:04.467519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:04.598473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:04.606920 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:04.608356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:04.610236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-352e8d92-96ff-43fb-94e2-0755f9548def tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.155431 Sep 24 15:03:04.610819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 254/492] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:04 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:05.178152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:05.178768 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:05.185221 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:05.185708 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:05.186178 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:05.186877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:05.187337 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:05.187765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:05.320195 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:05.328226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-22518d35-f115-49a3-be21-1d71676fbcf1 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1318 microversion: 2.1 time: 0.153518 Sep 24 15:03:05.328790 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 239/493] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:05 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:05.636350 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:05.636965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:05.643515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:05.644009 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:05.644455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:05.645178 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:05.645657 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:05.646107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:05.779508 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:05.788708 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:05.790232 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:05.791790 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-60826ed6-945f-4d06-b813-36a89ddfd140 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.159010 Sep 24 15:03:05.792358 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 255/494] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:05 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:06.349847 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:06.350600 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:06.356965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:06.357455 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:06.357916 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:06.358668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:06.359675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:06.360108 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:06.485069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:06.493049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f2fc389b-9580-4d5b-b3d9-9ad5adeaf8f2 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1318 microversion: 2.1 time: 0.146873 Sep 24 15:03:06.493605 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 240/495] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:06 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:06.817469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:06.818545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:06.824578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:06.825085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:06.825534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:06.826301 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:06.826768 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:06.827206 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:06.962331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:06.972072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:06.973584 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:06.974814 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8558d731-0181-44e5-888d-e673e1613c84 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.162249 Sep 24 15:03:06.975382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 256/496] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:06 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:07.128798 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-ae14e49d-99f8-4774-92dc-2157a69f3cd5 req-a6c480b7-0158-434f-9e4d-e6bf26338458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19f67b4-8d76-4f55-b9d8-5d138a544c18", "name": "network-vif-plugged", "status": "completed", "tag": "b632a1f7-1eee-4b21-9418-8b21faf2f31e"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:07.138453 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ae14e49d-99f8-4774-92dc-2157a69f3cd5 req-a6c480b7-0158-434f-9e4d-e6bf26338458 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:07.138932 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ae14e49d-99f8-4774-92dc-2157a69f3cd5 req-a6c480b7-0158-434f-9e4d-e6bf26338458 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:07.139375 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ae14e49d-99f8-4774-92dc-2157a69f3cd5 req-a6c480b7-0158-434f-9e4d-e6bf26338458 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:07.151793 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-ae14e49d-99f8-4774-92dc-2157a69f3cd5 req-a6c480b7-0158-434f-9e4d-e6bf26338458 service nova] Creating event network-vif-plugged:b632a1f7-1eee-4b21-9418-8b21faf2f31e for instance e19f67b4-8d76-4f55-b9d8-5d138a544c18 on hv-cinder-85919 Sep 24 15:03:07.157288 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-ae14e49d-99f8-4774-92dc-2157a69f3cd5 req-a6c480b7-0158-434f-9e4d-e6bf26338458 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Sep 24 15:03:07.157845 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 241/497] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:07.515573 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:07.516187 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:07.522301 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:07.522799 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:07.523246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:07.523945 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:07.524412 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:07.524847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:07.656078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:07.659496 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:07.664693 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-75b0b1da-1220-4010-9e30-58bf26ae0c0c tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1318 microversion: 2.1 time: 0.152872 Sep 24 15:03:07.665272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 257/498] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:07 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:08.001940 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:08.002673 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:08.008683 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:08.009170 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:08.009615 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:08.010351 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:08.010815 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:08.011247 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:08.015850 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:08.142231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:08.150730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:08.152184 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:08.153354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0a07e51e-0a4f-433d-9245-b9725bf813ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.156861 Sep 24 15:03:08.153940 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 242/499] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:07 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:08.686806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:08.687553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:08.689377 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:08.690137 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=12 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:08.696176 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:08.696722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:08.697166 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:08.697897 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:08.698382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:08.698811 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:08.824874 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:08.833114 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2915250a-70c0-4ad7-975a-5211abec3a2f tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1318 microversion: 2.1 time: 0.150432 Sep 24 15:03:08.833687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 258/500] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:08 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:09.184941 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:09.185585 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:09.192660 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:09.193142 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:09.193579 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:09.194292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:09.194749 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:09.195172 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:09.261572 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-4e28aadc-12c0-4911-bec1-9a553e53115c req-7ddfd562-5f34-47c6-b1de-a148283c4ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b247c5c-f642-4bcf-9c60-4b993f241a74", "name": "network-vif-plugged", "status": "completed", "tag": "4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:09.271185 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-4e28aadc-12c0-4911-bec1-9a553e53115c req-7ddfd562-5f34-47c6-b1de-a148283c4ce5 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:09.271880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-4e28aadc-12c0-4911-bec1-9a553e53115c req-7ddfd562-5f34-47c6-b1de-a148283c4ce5 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:09.272082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-4e28aadc-12c0-4911-bec1-9a553e53115c req-7ddfd562-5f34-47c6-b1de-a148283c4ce5 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:09.283777 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-4e28aadc-12c0-4911-bec1-9a553e53115c req-7ddfd562-5f34-47c6-b1de-a148283c4ce5 service nova] Creating event network-vif-plugged:4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67 for instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 on hv-cinder-85919 Sep 24 15:03:09.289320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-4e28aadc-12c0-4911-bec1-9a553e53115c req-7ddfd562-5f34-47c6-b1de-a148283c4ce5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031401 Sep 24 15:03:09.289935 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 259/501] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:03:09.323619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:09.332790 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:09.334280 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:09.335515 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a016171a-e940-4042-a751-6a9ded81107f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.154533 Sep 24 15:03:09.336079 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 243/502] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:09 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:09.856663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:09.857371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:09.863576 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:09.864073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:09.864778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:09.865483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:09.865961 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:09.866404 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:10.004198 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:10.011963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b4747f2c-f370-4b27-88d6-da2d0005f446 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1508 microversion: 2.1 time: 0.159464 Sep 24 15:03:10.012465 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 260/503] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:09 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:10.034985 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-963776c9-7ca6-4a57-9b7e-caf42d351858 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd302d83-035f-48b4-875a-2d6248bfd10d", "device": "/dev/sdb"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:10.037530 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-963776c9-7ca6-4a57-9b7e-caf42d351858 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:10.043579 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-963776c9-7ca6-4a57-9b7e-caf42d351858 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:10.044077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-963776c9-7ca6-4a57-9b7e-caf42d351858 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:10.044501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-963776c9-7ca6-4a57-9b7e-caf42d351858 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:10.045196 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-963776c9-7ca6-4a57-9b7e-caf42d351858 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:10.045649 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-963776c9-7ca6-4a57-9b7e-caf42d351858 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:10.046690 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-963776c9-7ca6-4a57-9b7e-caf42d351858 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:10.361318 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:10.361851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:10.368011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:10.368503 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:10.368940 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:10.369630 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:10.370125 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:10.370553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:10.496160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:10.504602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:10.506083 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:10.507239 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7491d4da-1e11-4a07-8ad3-24dbb66f3176 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.149891 Sep 24 15:03:10.507795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 261/504] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:10 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:03:10.801582 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-963776c9-7ca6-4a57-9b7e-caf42d351858 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "POST /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770994 Sep 24 15:03:10.802240 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 244/505] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:03:10 2022] POST /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:11.533128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:11.533887 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:11.539844 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:11.540435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:11.540964 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:11.541667 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:11.542163 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:11.542598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:11.922608 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:11.931460 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:11.932945 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:11.934488 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ef79f54e-8fbf-4df6-a7c2-fcc8a25ea2ed tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.405820 Sep 24 15:03:11.935068 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 262/506] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:11 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:11.971010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1328119391", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1433808875", "security_groups": [{"name": "tempest-secgroup-smoke-1671747737"}], "networks": [{"uuid": "505c0555-d938-4615-8d1a-d26100dc2e3e"}], "block_device_mapping_v2": [{"uuid": "3cdee7ea-25be-4862-b939-88865146c04b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:11.981308 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=46 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:12.087052 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] validate_networks() for [('505c0555-d938-4615-8d1a-d26100dc2e3e', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:03:12.459584 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:03:12.460022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:03:12.460526 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:03:12.461152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:03:12.461579 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:03:12.470904 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:12.471395 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:12.471841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:12.472608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:12.473070 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:12.473501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:12.491170 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Getting quotas for project 43e1ec63be6740fa9516a2e5331986a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:03:12.494856 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Getting quotas for user c8a3f8bef9f0431eac090f8a520f744b and project 43e1ec63be6740fa9516a2e5331986a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:03:12.551888 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:03:12.554342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3cdee7ea-25be-4862-b939-88865146c04b',volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:03:12.685066 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f77c9225-fcb4-4529-afb3-3219193d07cb tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.719238 Sep 24 15:03:12.685668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 245/507] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:03:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:03:12.697551 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c4eb4b69-036c-4c69-8f98-8a54a3d9858a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:12.698167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c4eb4b69-036c-4c69-8f98-8a54a3d9858a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:12.760912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c4eb4b69-036c-4c69-8f98-8a54a3d9858a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:12.768865 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c4eb4b69-036c-4c69-8f98-8a54a3d9858a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1089 microversion: 2.1 time: 0.075620 Sep 24 15:03:12.769772 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 263/508] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:12 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:12.965451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:12.966623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:12.982616 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:12.983219 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:12.983577 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:12.984283 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:12.984768 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:12.985365 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:13.131619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:13.141041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:13.142541 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:13.143710 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-474a6998-92bf-4368-a830-c320ec8140c9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1811 microversion: 2.20 time: 0.188107 Sep 24 15:03:13.157778 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 246/509] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:12 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1811 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:13.793921 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:13.795002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:13.802538 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:13.803078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:13.803634 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:13.804349 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:13.804815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:13.805249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:13.867512 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:13.875462 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-50bd8fd7-3456-4b86-85c0-6a83cc3e3020 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1187 microversion: 2.1 time: 0.085422 Sep 24 15:03:13.876033 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 264/510] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:13 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:14.169089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:14.169655 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:14.176016 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:14.176505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:14.176947 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:14.177637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:14.178128 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:14.178563 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:14.315757 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:14.325445 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:14.326943 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:14.328722 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f5555e07-3b47-43a7-960f-c2331e0edd6a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1798 microversion: 2.20 time: 0.163727 Sep 24 15:03:14.329361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 247/511] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:03:14 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1798 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:03:14.898442 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:14.899172 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:14.905108 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:14.906312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:14.906834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:14.907606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:14.908145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:14.908652 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:14.980676 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:14.988317 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-be19f664-c87b-44d8-ae04-b44947fff637 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1205 microversion: 2.1 time: 0.093811 Sep 24 15:03:14.988891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 265/512] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:14 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1205 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:15.567813 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-09c7a0e4-3680-4b82-b81b-56303d86e2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:15.568411 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-09c7a0e4-3680-4b82-b81b-56303d86e2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:15.575004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c7a0e4-3680-4b82-b81b-56303d86e2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:15.575514 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c7a0e4-3680-4b82-b81b-56303d86e2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:15.575972 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c7a0e4-3680-4b82-b81b-56303d86e2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:15.576822 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c7a0e4-3680-4b82-b81b-56303d86e2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:15.578000 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c7a0e4-3680-4b82-b81b-56303d86e2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:15.579544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c7a0e4-3680-4b82-b81b-56303d86e2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:15.612629 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-09c7a0e4-3680-4b82-b81b-56303d86e2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed/ips" status: 200 len: 150 microversion: 2.1 time: 0.048752 Sep 24 15:03:15.613294 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 248/513] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 15:03:15 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:15.626971 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f80c3bb-a34d-4002-b1ae-a1359ee46c25"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:15.630027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:15.636015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:15.636519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:15.636960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:15.637703 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:15.638194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:15.638623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:15.721722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Invalid volume: volume 7f80c3bb-a34d-4002-b1ae-a1359ee46c25 is already attached to instances: ab04a4f5-03a9-4af4-b050-f54f2f0821b8 Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: POST /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed/os-volume_attachments HTTP/1.1 Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 74 Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:03:15.723485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {"volumeAttachment": {"volumeId": "7f80c3bb-a34d-4002-b1ae-a1359ee46c25"}} Sep 24 15:03:15.725008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Invalid volume: volume 7f80c3bb-a34d-4002-b1ae-a1359ee46c25 is already attached to instances: ab04a4f5-03a9-4af4-b050-f54f2f0821b8 Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'server_id': '2e9dbe91-58e2-4672-9c57-0ad669724eed', 'body': {'volumeAttachment': {'volumeId': '7f80c3bb-a34d-4002-b1ae-a1359ee46c25'}}} Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7f80c3bb-a34d-4002-b1ae-a1359ee46c25 is already attached to instances: ab04a4f5-03a9-4af4-b050-f54f2f0821b8 Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:15.725845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7f80c3bb-a34d-4002-b1ae-a1359ee46c25 is already attached to instances: ab04a4f5-03a9-4af4-b050-f54f2f0821b8 Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:15.727250 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:15.728618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:15.728618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:03:15.728618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:03:15.728618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7f80c3bb-a34d-4002-b1ae-a1359ee46c25 is already attached to instances: ab04a4f5-03a9-4af4-b050-f54f2f0821b8 Sep 24 15:03:15.728618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:15.728618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 400 to user: Invalid volume: volume 7f80c3bb-a34d-4002-b1ae-a1359ee46c25 is already attached to instances: ab04a4f5-03a9-4af4-b050-f54f2f0821b8 {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:03:15.728618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-237f58ca-ad46-4515-bc4a-8c808d5834ff tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103720 Sep 24 15:03:15.728618 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 266/514] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:03:15 2022] POST /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 15:03:15.735045 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:15.735640 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:15.742261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:15.742749 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:15.743197 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:15.744112 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:15.745071 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:15.745071 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:15.770634 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:03:15.828215 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-2c0d38a6-e5d8-49b2-954b-760a26640d54 req-ec4ded0e-855e-4615-a1aa-2aa73c317b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775dbe6e-e603-4a12-84b4-3bae6637954d", "tag": "10e26e89-d2cf-44a3-8d75-3fdc714831ff"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:15.838969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-2c0d38a6-e5d8-49b2-954b-760a26640d54 req-ec4ded0e-855e-4615-a1aa-2aa73c317b4b service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:15.839673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-2c0d38a6-e5d8-49b2-954b-760a26640d54 req-ec4ded0e-855e-4615-a1aa-2aa73c317b4b service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:15.840388 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-2c0d38a6-e5d8-49b2-954b-760a26640d54 req-ec4ded0e-855e-4615-a1aa-2aa73c317b4b service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:15.853344 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-2c0d38a6-e5d8-49b2-954b-760a26640d54 req-ec4ded0e-855e-4615-a1aa-2aa73c317b4b service nova] Creating event network-changed:10e26e89-d2cf-44a3-8d75-3fdc714831ff for instance 775dbe6e-e603-4a12-84b4-3bae6637954d on hv-cinder-85919 Sep 24 15:03:15.861005 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-2c0d38a6-e5d8-49b2-954b-760a26640d54 req-ec4ded0e-855e-4615-a1aa-2aa73c317b4b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036663 Sep 24 15:03:15.862277 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 267/515] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:15.862558 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-692e8a2a-0789-413d-ac3a-8329f074efd8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 204 len: 0 microversion: 2.1 time: 0.131510 Sep 24 15:03:15.863222 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 249/516] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:03:15 2022] DELETE /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:03:15.872666 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:15.873371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:15.879470 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:15.879964 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:15.880404 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:15.881110 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:15.881598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:15.882024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:16.012027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:16.012857 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:16.018793 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:16.019570 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:16.020065 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:16.020502 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:16.021196 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:16.021652 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:16.022101 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:16.027058 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fdec7bd6-bfd8-4e19-bebe-4bf94fe9429f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1683 microversion: 2.1 time: 0.158626 Sep 24 15:03:16.027664 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 268/517] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:15 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:16.153736 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:16.161368 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b9bf499c-7e55-46a4-b039-1a91681dc70f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1273 microversion: 2.1 time: 0.153613 Sep 24 15:03:16.162152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 250/518] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:16 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:17.051064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:17.051593 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:17.057537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:17.058077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:17.058526 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:17.059224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:17.059691 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:17.060127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:17.183469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:17.184091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:17.190894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:17.191390 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:17.191839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:17.192314 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:17.192593 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:17.193064 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:17.193503 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:17.200614 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9b338a9d-2f87-4376-a475-2bb6ca73c2a8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1683 microversion: 2.1 time: 0.153539 Sep 24 15:03:17.201390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 269/519] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:17 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:17.333741 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:17.341535 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4a46d83c-da16-4fb9-af50-ec70faa58679 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1273 microversion: 2.1 time: 0.161897 Sep 24 15:03:17.342131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 251/520] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:17 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:18.225088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:18.225703 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:18.232407 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:18.232947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:18.233433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:18.234193 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:18.234840 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:18.235845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:18.364848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:18.365546 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:18.366230 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:18.372567 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:18.372905 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a4a78962-4579-404b-9308-9a962947b06d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1683 microversion: 2.1 time: 0.151713 Sep 24 15:03:18.373064 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:18.373512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:18.373629 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 270/521] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:18 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:18.376082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:18.376566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:18.377014 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:18.508059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:18.516002 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-33dd9422-34a2-4659-9e5d-63aaffa70fe4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1273 microversion: 2.1 time: 0.154699 Sep 24 15:03:18.516593 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 252/522] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:18 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:19.398222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:19.399211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:19.407749 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:19.408240 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:19.410726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:19.412566 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:19.413561 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:19.414986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:19.542784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:19.543720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:19.563067 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:19.570298 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:19.571014 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:19.571632 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:19.572339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b9495a6a-35a4-4679-a97b-d7605d6e28a5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1615 microversion: 2.1 time: 0.179026 Sep 24 15:03:19.572799 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:19.573617 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:19.574349 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:19.585839 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 271/523] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:19 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1615 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:19.724430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:19.732789 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-57871453-758d-4e7f-b966-3c999401916f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.194830 Sep 24 15:03:19.733962 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 253/524] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:19 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:19.861547 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-752420a6-ee42-442c-b41c-dacf05ca8bb3 req-a76235d8-1a6c-4820-b9f2-ddbee3fea334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e9dbe91-58e2-4672-9c57-0ad669724eed", "name": "network-vif-deleted", "tag": "785318ab-a784-470a-b060-4ed1ab4ff69e"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:19.872145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-752420a6-ee42-442c-b41c-dacf05ca8bb3 req-a76235d8-1a6c-4820-b9f2-ddbee3fea334 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:19.872627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-752420a6-ee42-442c-b41c-dacf05ca8bb3 req-a76235d8-1a6c-4820-b9f2-ddbee3fea334 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:19.873057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-752420a6-ee42-442c-b41c-dacf05ca8bb3 req-a76235d8-1a6c-4820-b9f2-ddbee3fea334 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:19.884915 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-752420a6-ee42-442c-b41c-dacf05ca8bb3 req-a76235d8-1a6c-4820-b9f2-ddbee3fea334 service nova] Creating event network-vif-deleted:785318ab-a784-470a-b060-4ed1ab4ff69e for instance 2e9dbe91-58e2-4672-9c57-0ad669724eed on hv-cinder-85919 Sep 24 15:03:19.890283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-752420a6-ee42-442c-b41c-dacf05ca8bb3 req-a76235d8-1a6c-4820-b9f2-ddbee3fea334 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032887 Sep 24 15:03:19.891204 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 272/525] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:20.596497 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:20.597101 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:20.604066 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:20.604877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:20.605405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:20.606157 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:20.606768 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:20.607216 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:20.680162 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:20.690707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8fc3e1fd-c455-4d85-a252-557b55406b02 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1615 microversion: 2.1 time: 0.098557 Sep 24 15:03:20.691817 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 254/526] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:20 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:20.758945 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:20.759678 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:20.766343 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:20.767363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:20.767797 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:20.768498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:20.768954 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:20.769560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:20.912679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:20.923795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-af58efeb-0ff3-45ee-8458-73bc7b1a6f39 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.167920 Sep 24 15:03:20.924740 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 273/527] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:20 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:21.715326 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:21.715946 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:21.718407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 15:03:21.718566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Sat Sep 24 15:03:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed (ip 10.222.0.61) !!! Sep 24 15:03:21.726934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:21.726934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:21.727310 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:21.728013 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:21.728458 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:21.728904 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:21.797523 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:21.805283 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a8812be1-6854-492f-98f9-1b39e2c68d06 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1615 microversion: 2.1 time: 0.093924 Sep 24 15:03:21.805849 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 255/528] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:21 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:21.947709 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:21.948327 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:21.954945 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:21.955440 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:21.955901 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:21.956602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:21.957069 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:21.957500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:22.083333 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:22.090926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c83ff897-5f9a-4f0f-acea-40d363ae05a6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.147129 Sep 24 15:03:22.091491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 274/529] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:21 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:22.821717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7b7f9bc9-3e50-41fa-8418-59f89c9518b7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a214d6b-b485-4315-8301-7428515bb389"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:22.826867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7b7f9bc9-3e50-41fa-8418-59f89c9518b7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:22.829460 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:22.830366 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:22.832947 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:22.834045 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:22.836428 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:22.837933 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b7f9bc9-3e50-41fa-8418-59f89c9518b7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:22.839904 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:22.840150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:22.840786 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:22.840914 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b7f9bc9-3e50-41fa-8418-59f89c9518b7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:22.841402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b7f9bc9-3e50-41fa-8418-59f89c9518b7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:22.841525 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:22.842113 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:22.842225 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b7f9bc9-3e50-41fa-8418-59f89c9518b7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:22.842496 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:22.842692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b7f9bc9-3e50-41fa-8418-59f89c9518b7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:22.843018 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7b7f9bc9-3e50-41fa-8418-59f89c9518b7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:22.920930 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:22.930487 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-28475f4c-9cfa-4f7a-8362-1591f9c07969 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1327 microversion: 2.1 time: 0.105391 Sep 24 15:03:22.931311 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 275/530] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:22 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:22.934122 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:23.114066 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:23.114871 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:23.116650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:23.123354 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:23.124186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:23.124645 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:23.125359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:23.125932 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:23.126658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:23.259613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:23.267819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bbcd2446-085e-4d3d-b6ff-20e168db12a1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.157768 Sep 24 15:03:23.268394 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 276/531] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:23 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:23.954168 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:23.954425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7b7f9bc9-3e50-41fa-8418-59f89c9518b7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.135829 Sep 24 15:03:23.954906 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:23.955370 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 256/532] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:03:22 2022] POST /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments => generated 194 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:23.967382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:23.968916 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:23.970189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:23.972268 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:23.973177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:23.973870 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:23.993553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:24.007044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:24.007706 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:24.008146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:24.008676 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lazy-loading 'fault' on Instance uuid 2e9dbe91-58e2-4672-9c57-0ad669724eed {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:03:24.060133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:24.068474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6813f1e6-9302-45a3-bd5d-d9e0332829d0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1332 microversion: 2.1 time: 0.118802 Sep 24 15:03:24.069043 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 277/533] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:23 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:24.291350 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:24.292087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:24.299258 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:24.299748 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:24.300191 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:24.300885 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:24.301348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:24.301780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:24.430867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:24.438487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-016a81f1-0699-4b74-a583-3cc20779416c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.151330 Sep 24 15:03:24.439053 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 257/534] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:24 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:25.091431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:25.092052 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:25.101389 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:25.101886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:25.102359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:25.103056 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:25.103521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:25.103955 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:25.135337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:25.135825 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:25.136265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:25.136714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lazy-loading 'fault' on Instance uuid 2e9dbe91-58e2-4672-9c57-0ad669724eed {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:03:25.175852 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:25.183608 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-126a569d-1c8c-46ca-867e-926e756f235d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1332 microversion: 2.1 time: 0.096094 Sep 24 15:03:25.184174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 278/535] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:25 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:25.460971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:25.461548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:25.467927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:25.468425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:25.468870 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:25.469569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:25.470074 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:25.470508 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:25.596939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:25.604668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-52912114-fc90-46b6-86e8-67c154dde173 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.147683 Sep 24 15:03:25.605245 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 258/536] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:25 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:26.207006 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:26.207622 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:26.213472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:26.213985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:26.214425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:26.215109 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:26.215563 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:26.216016 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:26.245660 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:26.246165 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:26.246603 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:26.247044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lazy-loading 'fault' on Instance uuid 2e9dbe91-58e2-4672-9c57-0ad669724eed {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:03:26.287338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:26.294887 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9a3cb90f-8ff3-4a67-9974-30e88b5ed011 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 200 len: 1332 microversion: 2.1 time: 0.092173 Sep 24 15:03:26.295451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 279/537] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:26 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:26.627605 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:26.628226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:26.634707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:26.635209 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:26.635658 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:26.636355 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:26.636820 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:26.637256 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:26.771904 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:26.779674 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-737eea32-e097-4312-806f-c4bb31ed2782 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.156506 Sep 24 15:03:26.780252 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 259/538] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:26 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:27.316526 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:27.317238 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:27.323170 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:27.323656 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:27.324092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:27.324780 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:27.325266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:27.325693 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:27.338815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed HTTP/1.1 Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:03:27.340500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:03:27.342094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '2e9dbe91-58e2-4672-9c57-0ad669724eed'} Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:03:27.343124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:03:27.345082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:27.346536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:03:27.346536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-97a8bbb5-bb61-47bb-99b8-94ad30607d3a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 404 len: 111 microversion: 2.1 time: 0.029286 Sep 24 15:03:27.346536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 280/539] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:27 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:03:27.351202 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d5227d32-4183-4110-97bd-c7126afcb616 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '.version_select at 0x7f7c1104f820>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:27.373644 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d5227d32-4183-4110-97bd-c7126afcb616 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045115923" status: 202 len: 0 microversion: 2.1 time: 0.026181 Sep 24 15:03:27.374220 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 260/540] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Sep 24 15:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2045115923 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 15:03:27.802286 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:27.802936 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:27.808771 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:27.809265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:27.809706 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:27.810456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:27.810922 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:27.811356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:27.942051 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:27.950302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8edafd3d-8b02-45aa-b8d0-32a196677880 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.151924 Sep 24 15:03:27.951136 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 281/541] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:27 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:28.315315 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:28.315839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:28.322556 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:28.323055 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:28.323499 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:28.324197 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:28.324732 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:28.325161 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:28.448338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lazy-loading 'services' on Instance uuid ab04a4f5-03a9-4af4-b050-f54f2f0821b8 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:03:28.556954 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-99c3db3f-d9f7-48c1-a99f-688f1e8f6ceb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments/7f80c3bb-a34d-4002-b1ae-a1359ee46c25" status: 202 len: 0 microversion: 2.1 time: 0.246739 Sep 24 15:03:28.557535 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 261/542] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:03:28 2022] DELETE /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments/7f80c3bb-a34d-4002-b1ae-a1359ee46c25 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:03:28.566705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-065e43b9-eb1b-4255-9d50-67aac17059b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:28.569040 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-065e43b9-eb1b-4255-9d50-67aac17059b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:28.575315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-065e43b9-eb1b-4255-9d50-67aac17059b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:28.575856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-065e43b9-eb1b-4255-9d50-67aac17059b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:28.576333 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-065e43b9-eb1b-4255-9d50-67aac17059b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:28.577055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-065e43b9-eb1b-4255-9d50-67aac17059b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:28.577560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-065e43b9-eb1b-4255-9d50-67aac17059b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:28.578054 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-065e43b9-eb1b-4255-9d50-67aac17059b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:28.610427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-065e43b9-eb1b-4255-9d50-67aac17059b8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047916 Sep 24 15:03:28.611005 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 282/543] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:03:28 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:28.873465 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-dc74b739-c7c2-4d00-8d0f-f92a6bd62268 req-b73908bb-d86d-4832-8707-641a6c923f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775dbe6e-e603-4a12-84b4-3bae6637954d", "name": "network-vif-plugged", "status": "completed", "tag": "10e26e89-d2cf-44a3-8d75-3fdc714831ff"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:28.885387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dc74b739-c7c2-4d00-8d0f-f92a6bd62268 req-b73908bb-d86d-4832-8707-641a6c923f16 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:28.886063 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dc74b739-c7c2-4d00-8d0f-f92a6bd62268 req-b73908bb-d86d-4832-8707-641a6c923f16 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:28.886511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dc74b739-c7c2-4d00-8d0f-f92a6bd62268 req-b73908bb-d86d-4832-8707-641a6c923f16 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:28.898141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-dc74b739-c7c2-4d00-8d0f-f92a6bd62268 req-b73908bb-d86d-4832-8707-641a6c923f16 service nova] Creating event network-vif-plugged:10e26e89-d2cf-44a3-8d75-3fdc714831ff for instance 775dbe6e-e603-4a12-84b4-3bae6637954d on hv-cinder-85919 Sep 24 15:03:28.903147 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-dc74b739-c7c2-4d00-8d0f-f92a6bd62268 req-b73908bb-d86d-4832-8707-641a6c923f16 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034090 Sep 24 15:03:28.904250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 262/544] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:28.973017 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:28.973650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:28.979722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:28.980207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:28.980642 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:28.981333 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:28.981794 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:28.982243 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:29.122477 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:29.130692 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2268beb7-0800-4b0d-ba52-349b3b0cd8f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.161813 Sep 24 15:03:29.131329 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 283/545] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:28 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:29.623048 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b18c4123-ac01-4bb5-9d89-020fd2bfad88 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:29.625285 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b18c4123-ac01-4bb5-9d89-020fd2bfad88 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:29.631845 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b18c4123-ac01-4bb5-9d89-020fd2bfad88 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:29.632336 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b18c4123-ac01-4bb5-9d89-020fd2bfad88 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:29.632779 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b18c4123-ac01-4bb5-9d89-020fd2bfad88 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:29.633474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b18c4123-ac01-4bb5-9d89-020fd2bfad88 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:29.633957 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b18c4123-ac01-4bb5-9d89-020fd2bfad88 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:29.634394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b18c4123-ac01-4bb5-9d89-020fd2bfad88 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:29.663592 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b18c4123-ac01-4bb5-9d89-020fd2bfad88 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044817 Sep 24 15:03:29.664120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 263/546] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:03:29 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:30.153819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:30.154457 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:30.161014 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:30.161500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:30.161959 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:30.162648 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:30.163100 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:30.163545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:30.295686 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:30.304054 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0d56c338-6d37-462a-90e9-d59ff6f8f438 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.154014 Sep 24 15:03:30.305038 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 284/547] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:30 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:30.677028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bbd0dce8-18ac-4233-9955-de252a822b76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:30.679139 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bbd0dce8-18ac-4233-9955-de252a822b76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:30.685473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbd0dce8-18ac-4233-9955-de252a822b76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:30.686060 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbd0dce8-18ac-4233-9955-de252a822b76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:30.686451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbd0dce8-18ac-4233-9955-de252a822b76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:30.687179 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbd0dce8-18ac-4233-9955-de252a822b76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:30.687644 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbd0dce8-18ac-4233-9955-de252a822b76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:30.688647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bbd0dce8-18ac-4233-9955-de252a822b76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:30.722408 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bbd0dce8-18ac-4233-9955-de252a822b76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049895 Sep 24 15:03:30.722963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 264/548] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:03:30 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:31.327623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:31.328377 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:31.334848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:31.335348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:31.335785 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:31.336481 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:31.336941 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:31.337374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:31.357710 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:31.358244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:31.364061 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:31.364820 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:31.365272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:31.365998 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:31.366465 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:31.366901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:31.470315 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lazy-loading 'services' on Instance uuid e19f67b4-8d76-4f55-b9d8-5d138a544c18 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:03:31.492586 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:31.502513 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-54255c63-245e-4a32-b95e-29a4fcc2b876 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1261 microversion: 2.1 time: 0.178650 Sep 24 15:03:31.503088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 285/549] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:31 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:31.549506 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-39ca45e1-0dfa-4564-b33b-17ce02542526 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18/os-volume_attachments/fd302d83-035f-48b4-875a-2d6248bfd10d" status: 202 len: 0 microversion: 2.1 time: 0.195477 Sep 24 15:03:31.550126 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 265/550] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:03:31 2022] DELETE /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18/os-volume_attachments/fd302d83-035f-48b4-875a-2d6248bfd10d => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 15:03:31.735158 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-80640fda-0ba6-48bf-88e0-021133a41fcb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:31.737390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-80640fda-0ba6-48bf-88e0-021133a41fcb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:31.743583 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80640fda-0ba6-48bf-88e0-021133a41fcb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:31.744089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80640fda-0ba6-48bf-88e0-021133a41fcb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:31.744528 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80640fda-0ba6-48bf-88e0-021133a41fcb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:31.745239 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80640fda-0ba6-48bf-88e0-021133a41fcb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:31.745698 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80640fda-0ba6-48bf-88e0-021133a41fcb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:31.746167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80640fda-0ba6-48bf-88e0-021133a41fcb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:31.781010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-80640fda-0ba6-48bf-88e0-021133a41fcb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049756 Sep 24 15:03:31.782038 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 286/551] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:03:31 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:32.526368 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:32.527082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:32.533576 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:32.534103 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:32.534551 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:32.535245 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:32.535712 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:32.536143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:32.670905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:32.679606 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c6eb5108-9e0c-4d0d-81fa-e1f31449a4fa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1445 microversion: 2.1 time: 0.157942 Sep 24 15:03:32.680195 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 266/552] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:32 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:32.701393 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:32.701965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:32.707961 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:32.708441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:32.708888 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:32.709583 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:32.710086 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:32.710525 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:32.794648 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bffb0b4f-6199-438f-a655-731fae5d1bd5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:32.798272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bffb0b4f-6199-438f-a655-731fae5d1bd5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:32.805578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bffb0b4f-6199-438f-a655-731fae5d1bd5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:32.805578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bffb0b4f-6199-438f-a655-731fae5d1bd5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:32.806342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bffb0b4f-6199-438f-a655-731fae5d1bd5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:32.807593 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bffb0b4f-6199-438f-a655-731fae5d1bd5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:32.807593 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bffb0b4f-6199-438f-a655-731fae5d1bd5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:32.808165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bffb0b4f-6199-438f-a655-731fae5d1bd5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:32.839017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bffb0b4f-6199-438f-a655-731fae5d1bd5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048383 Sep 24 15:03:32.839816 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 267/553] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:03:32 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:03:32.857491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:32.865576 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-acdbe980-2680-4915-81c7-1d6e3e76f2e1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1445 microversion: 2.1 time: 0.168014 Sep 24 15:03:32.866269 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 287/554] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:32 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:33.851483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9a985bfb-f8e4-4292-962f-2f89bb2308b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:33.854250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9a985bfb-f8e4-4292-962f-2f89bb2308b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:33.861690 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a985bfb-f8e4-4292-962f-2f89bb2308b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:33.862482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a985bfb-f8e4-4292-962f-2f89bb2308b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:33.862927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a985bfb-f8e4-4292-962f-2f89bb2308b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:33.863863 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a985bfb-f8e4-4292-962f-2f89bb2308b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:33.864771 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a985bfb-f8e4-4292-962f-2f89bb2308b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:33.865388 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a985bfb-f8e4-4292-962f-2f89bb2308b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:33.896819 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9a985bfb-f8e4-4292-962f-2f89bb2308b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049213 Sep 24 15:03:33.897401 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 268/555] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:03:33 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:34.555683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-54f3e21e-4f2c-491a-85d2-65546fe97a04 req-4369d116-0d65-4497-97bf-ef7df0808d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775dbe6e-e603-4a12-84b4-3bae6637954d", "tag": "10e26e89-d2cf-44a3-8d75-3fdc714831ff"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:34.565419 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-54f3e21e-4f2c-491a-85d2-65546fe97a04 req-4369d116-0d65-4497-97bf-ef7df0808d63 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:34.565934 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-54f3e21e-4f2c-491a-85d2-65546fe97a04 req-4369d116-0d65-4497-97bf-ef7df0808d63 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:34.566388 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-54f3e21e-4f2c-491a-85d2-65546fe97a04 req-4369d116-0d65-4497-97bf-ef7df0808d63 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:34.579506 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-54f3e21e-4f2c-491a-85d2-65546fe97a04 req-4369d116-0d65-4497-97bf-ef7df0808d63 service nova] Creating event network-changed:10e26e89-d2cf-44a3-8d75-3fdc714831ff for instance 775dbe6e-e603-4a12-84b4-3bae6637954d on hv-cinder-85919 Sep 24 15:03:34.584705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-54f3e21e-4f2c-491a-85d2-65546fe97a04 req-4369d116-0d65-4497-97bf-ef7df0808d63 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032446 Sep 24 15:03:34.588141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 288/556] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:34.687901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:34.690088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:34.696711 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:34.697209 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:34.697655 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:34.698382 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:34.699213 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:34.699354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:34.723021 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lazy-loading 'flavor' on Instance uuid 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:03:34.910346 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cfad1809-d2ce-47d3-aed4-cc935e5de2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:34.911055 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e130401a-1995-417e-b262-6fb4ecb726ab tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/action" status: 200 len: 32 microversion: 2.1 time: 0.227135 Sep 24 15:03:34.911957 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 269/557] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:03:34 2022] POST /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 15:03:34.913112 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-cfad1809-d2ce-47d3-aed4-cc935e5de2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:34.919890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cfad1809-d2ce-47d3-aed4-cc935e5de2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:34.920509 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cfad1809-d2ce-47d3-aed4-cc935e5de2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:34.921060 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cfad1809-d2ce-47d3-aed4-cc935e5de2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:34.922186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cfad1809-d2ce-47d3-aed4-cc935e5de2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:34.922843 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cfad1809-d2ce-47d3-aed4-cc935e5de2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:34.923360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cfad1809-d2ce-47d3-aed4-cc935e5de2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:34.934803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:34.935999 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:34.942851 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:34.943349 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:34.943790 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:34.944687 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:34.945148 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:34.945877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:34.957754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-cfad1809-d2ce-47d3-aed4-cc935e5de2b4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052583 Sep 24 15:03:34.958449 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 289/558] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:03:34 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:03:34.965077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:35.079731 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:35.088037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c0a7c69f-4955-4bb6-92d7-9b583ebbdb1c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.163156 Sep 24 15:03:35.088622 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 270/559] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:34 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:35.897534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:35.898186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:35.904445 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:35.904934 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:35.905368 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:35.906093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:35.906562 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:35.908482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:35.933952 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Going to try to terminate instance {{(pid=120590) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:03:35.971904 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-00d7f5f3-9c67-4ff3-99e1-622236b2d517 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:35.974644 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-00d7f5f3-9c67-4ff3-99e1-622236b2d517 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:35.980864 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d7f5f3-9c67-4ff3-99e1-622236b2d517 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:35.981384 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d7f5f3-9c67-4ff3-99e1-622236b2d517 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:35.981804 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d7f5f3-9c67-4ff3-99e1-622236b2d517 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:35.982555 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d7f5f3-9c67-4ff3-99e1-622236b2d517 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:35.983106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d7f5f3-9c67-4ff3-99e1-622236b2d517 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:35.983448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d7f5f3-9c67-4ff3-99e1-622236b2d517 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:36.018784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c4103a06-aada-42d0-bee6-957a057f103a tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 204 len: 0 microversion: 2.1 time: 0.124745 Sep 24 15:03:36.022823 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 290/560] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:03:35 2022] DELETE /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:03:36.022982 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-00d7f5f3-9c67-4ff3-99e1-622236b2d517 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052701 Sep 24 15:03:36.022982 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 271/561] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:03:35 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 15:03:36.031619 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:36.032846 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:36.040030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:36.040030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:36.040030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:36.040405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:36.040869 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:36.041303 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:36.089806 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:36.090338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:36.096206 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:36.096693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:36.097124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:36.097816 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:36.098299 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:36.098724 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:36.126001 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:03:36.174721 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:36.183139 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ddbc36c0-7ca1-47d6-8c7c-87f731ced5c4 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1514 microversion: 2.1 time: 0.155770 Sep 24 15:03:36.184553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 291/562] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:36 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:36.189099 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:36.190069 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:36.196259 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:36.197017 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:36.197531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:36.198356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:36.199043 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:36.199698 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:36.200565 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-28a297fb-dd4c-4e5b-91e6-f8f42d90ac7f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 204 len: 0 microversion: 2.1 time: 0.114794 Sep 24 15:03:36.201156 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 272/563] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:03:36 2022] DELETE /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 15:03:36.210070 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:36.210932 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:36.216604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:36.217091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:36.217533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:36.218261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:36.218721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:36.219683 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:36.332015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:36.335538 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:36.340516 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-28bbc6ba-7dbf-4fe6-9a83-8f06a1a46f9b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.154849 Sep 24 15:03:36.341087 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 292/564] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:36 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:36.353502 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:36.362425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c33bec41-c9d4-4d54-8301-9fafb771e8e2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1682 microversion: 2.1 time: 0.156387 Sep 24 15:03:36.362995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 273/565] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:36 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:37.207975 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:37.208502 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:37.215251 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:37.215738 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:37.216174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:37.216865 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:37.217321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:37.217747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:37.342541 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:37.350111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a9efec51-4dfc-451d-8799-17c18080e594 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1514 microversion: 2.1 time: 0.146938 Sep 24 15:03:37.350675 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 293/566] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:37 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:37.364956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:37.365574 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:37.372063 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:37.372561 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:37.373115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:37.374319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:37.375173 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:37.376575 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:37.385541 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:37.386226 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:37.392058 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:37.392543 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:37.392981 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:37.393672 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:37.394154 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:37.394574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:37.512049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:37.520499 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fcc36a69-2806-400c-bae4-6fefc76b782e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.159696 Sep 24 15:03:37.521090 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 274/567] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:37 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:37.523517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:37.531214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d8c659e7-7cf8-4d38-83ee-e79b8cc5cf0c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1682 microversion: 2.1 time: 0.149409 Sep 24 15:03:37.531876 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 294/568] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:37 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:38.374050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:38.374656 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:38.380889 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:38.381377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:38.381812 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:38.382524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:38.382980 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:38.383402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:38.512054 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:38.520189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-763686c5-1767-48f0-b5c6-d798d124b719 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1514 microversion: 2.1 time: 0.150046 Sep 24 15:03:38.520757 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 275/569] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:38 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:38.543146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:38.543758 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:38.549749 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:38.550278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:38.550726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:38.551424 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:38.551889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:38.552321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:38.553865 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:38.554627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:38.560544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:38.561042 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:38.561482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:38.562229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:38.562695 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:38.563625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:38.684015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:38.692621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:38.692786 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f7124e3c-b4a1-47e5-a3c1-9ebfe619dbc5 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.153393 Sep 24 15:03:38.693495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 295/570] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:38 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:38.700951 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-43d66a3b-750c-4647-bfd1-704a221003df tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1682 microversion: 2.1 time: 0.150860 Sep 24 15:03:38.701597 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 276/571] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:38 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:39.542335 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:39.542947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:39.549784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:39.550477 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:39.550915 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:39.551610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:39.552063 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:39.552492 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:39.679403 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:39.687005 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4fd17737-92cc-4820-8088-ea7e4dff8910 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1514 microversion: 2.1 time: 0.148495 Sep 24 15:03:39.687578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 296/572] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:39 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:39.715946 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:39.716560 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:39.723559 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:39.724050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:39.724492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:39.724621 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:39.725185 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:39.725286 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:39.725652 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:39.726113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:39.731308 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:39.731559 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:39.732010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:39.732710 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:39.733171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:39.733759 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:39.856937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:39.863033 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:39.865706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6e847214-7908-4e23-b69b-004994ad6395 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.153502 Sep 24 15:03:39.866320 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 277/573] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:39 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:39.871158 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ad5b22c2-9adf-465b-b7d5-69b5047b2021 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1682 microversion: 2.1 time: 0.150148 Sep 24 15:03:39.871720 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 297/574] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:39 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:40.710186 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:40.711252 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:40.717129 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:40.717709 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:40.718102 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:40.718821 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:40.719288 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:40.719727 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:40.858885 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:40.867469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7f02aeca-d768-4d14-ab04-3079e8863317 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1514 microversion: 2.1 time: 0.161223 Sep 24 15:03:40.868132 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 278/575] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:40 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:40.888615 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:40.889565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:40.894782 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:40.895511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:40.896349 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:40.896854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:40.897302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:40.898065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:40.898535 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:40.898974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:40.902424 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:40.902927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:40.903584 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:40.904445 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:40.904916 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:40.905354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:41.038777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:41.046908 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-94e843ac-f0aa-40f4-9725-95bb44593f44 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1682 microversion: 2.1 time: 0.156068 Sep 24 15:03:41.048441 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 279/576] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:40 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:41.194854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:41.202920 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-cf45001c-605f-428d-9b2a-fd37e79734ce tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.318132 Sep 24 15:03:41.203499 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 298/577] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:40 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:41.301073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-febd3c2b-d419-4895-8dd6-f18df17db466 req-27722229-9be3-4aa6-a8bd-7ac0ea67357a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19f67b4-8d76-4f55-b9d8-5d138a544c18", "name": "network-vif-deleted", "tag": "b632a1f7-1eee-4b21-9418-8b21faf2f31e"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:41.306140 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:41.312236 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-febd3c2b-d419-4895-8dd6-f18df17db466 req-27722229-9be3-4aa6-a8bd-7ac0ea67357a service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:41.312730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-febd3c2b-d419-4895-8dd6-f18df17db466 req-27722229-9be3-4aa6-a8bd-7ac0ea67357a service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:41.313175 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-febd3c2b-d419-4895-8dd6-f18df17db466 req-27722229-9be3-4aa6-a8bd-7ac0ea67357a service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:41.326937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-febd3c2b-d419-4895-8dd6-f18df17db466 req-27722229-9be3-4aa6-a8bd-7ac0ea67357a service nova] Creating event network-vif-deleted:b632a1f7-1eee-4b21-9418-8b21faf2f31e for instance e19f67b4-8d76-4f55-b9d8-5d138a544c18 on hv-cinder-85919 Sep 24 15:03:41.332133 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-febd3c2b-d419-4895-8dd6-f18df17db466 req-27722229-9be3-4aa6-a8bd-7ac0ea67357a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035673 Sep 24 15:03:41.332749 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 280/578] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:41.892078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:41.892876 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:41.898844 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:41.899462 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:41.900025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:41.900842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:41.901396 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:41.902021 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:41.942657 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:41.943152 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:41.943595 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:41.944050 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lazy-loading 'fault' on Instance uuid e19f67b4-8d76-4f55-b9d8-5d138a544c18 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:03:41.988495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482233dae68d487ca9b2ff6c69684663', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e00eaec5c3a4b53b9e39346e792da01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:41.996483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-68e4434b-6bd3-45cd-b478-54a931f6a59e tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 200 len: 1308 microversion: 2.1 time: 0.108861 Sep 24 15:03:41.997156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 299/579] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:41 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:42.073777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:42.075169 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:42.083009 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:42.083840 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:42.084348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:42.085189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:42.085720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:42.086265 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:42.117530 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:42.118082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:42.118504 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:42.119330 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lazy-loading 'fault' on Instance uuid ab04a4f5-03a9-4af4-b050-f54f2f0821b8 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:03:42.167093 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:42.185013 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b23fdaa3-1706-44c7-8334-ae8f4a79d20e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 200 len: 1332 microversion: 2.1 time: 0.115870 Sep 24 15:03:42.186501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 281/580] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:42 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:42.226483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:42.227364 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:42.236101 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:42.236851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:42.238603 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:42.240490 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:42.243215 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:42.246756 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:42.399212 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:42.415788 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a19fea19-bf8a-44d9-9986-42179d88bc32 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.193126 Sep 24 15:03:42.416378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 300/581] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:42 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:43.022715 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:43.023677 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] [instance: e19f67b4-8d76-4f55-b9d8-5d138a544c18] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:43.029822 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:43.030368 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:43.030813 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:43.032082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:43.032550 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:43.032989 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:43.046144 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] HTTP exception thrown: Instance e19f67b4-8d76-4f55-b9d8-5d138a544c18 could not be found. Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Request method failure captured: Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 HTTP/1.1 Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxvCvX1mfTF3f5E8DQIvy1efDPALSXSG_uShb9n_tJw7WBT2nAvgmpmDD7i1auOUgC6NcvZJvCXDPxvts-YutsjNrlXwbt70AS3QCzBySWOFlscxPaNgpuiYxlEVFnhdpLXp07LV5ioMNvnJ0HPRI4Jq-eB18ctJpy4UiCI3Ql3XMfo Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 5e00eaec5c3a4b53b9e39346e792da01 Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1578941610 Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:03:43.047780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5e00eaec5c3a4b53b9e39346e792da01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5e00eaec5c3a4b53b9e39346e792da01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5e00eaec5c3a4b53b9e39346e792da01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5e00eaec5c3a4b53b9e39346e792da01"}]}] Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-VolumesSnapshotTestJSON-1578941610 Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 5e00eaec5c3a4b53b9e39346e792da01 Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1578941610 Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-VolumesSnapshotTestJSON-1578941610-project Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 482233dae68d487ca9b2ff6c69684663 Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-VolumesSnapshotTestJSON-1578941610-project Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance e19f67b4-8d76-4f55-b9d8-5d138a544c18 could not be found. Sep 24 15:03:43.049356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': 'e19f67b4-8d76-4f55-b9d8-5d138a544c18'} Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19f67b4-8d76-4f55-b9d8-5d138a544c18 could not be found. Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:03:43.050188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19f67b4-8d76-4f55-b9d8-5d138a544c18 could not be found. Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19f67b4-8d76-4f55-b9d8-5d138a544c18 could not be found. Sep 24 15:03:43.051505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.052566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] Returning 404 to user: Instance e19f67b4-8d76-4f55-b9d8-5d138a544c18 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:03:43.052566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b13016c9-c230-46ef-bdc2-b883677d2035 tempest-VolumesSnapshotTestJSON-1578941610 tempest-VolumesSnapshotTestJSON-1578941610-project] 10.222.0.61 "GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18" status: 404 len: 111 microversion: 2.1 time: 0.033230 Sep 24 15:03:43.052566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 282/582] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:43 2022] GET /compute/v2.1/servers/e19f67b4-8d76-4f55-b9d8-5d138a544c18 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:03:43.210359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:43.211506 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:43.217341 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:43.217834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:43.218300 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:43.219078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:43.220071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:43.220491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:43.234324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 HTTP/1.1 Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:03:43.236096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:03:43.237631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'ab04a4f5-03a9-4af4-b050-f54f2f0821b8'} Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:03:43.238650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:03:43.240291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:03:43.241569 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:03:43.241569 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fdfa29f2-0bad-4bbd-91b5-23cf62a4136e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 404 len: 111 microversion: 2.1 time: 0.031225 Sep 24 15:03:43.241732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 301/583] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:43 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:03:43.246788 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5acb745f-4900-408c-814f-c1251c07d4e7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '.version_select at 0x7f7c10b4e0d0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:43.276928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5acb745f-4900-408c-814f-c1251c07d4e7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375814724" status: 202 len: 0 microversion: 2.1 time: 0.033796 Sep 24 15:03:43.277662 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 283/584] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Sep 24 15:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375814724 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:03:43.349064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-593d07d0-22f2-4d3b-b4d9-d1735d58b1cf req-cc42b1cd-13fd-40e6-b8ab-66e8a7e84506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab04a4f5-03a9-4af4-b050-f54f2f0821b8", "name": "network-vif-deleted", "tag": "425e5416-b421-4837-9184-b721b4762280"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:43.358647 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-593d07d0-22f2-4d3b-b4d9-d1735d58b1cf req-cc42b1cd-13fd-40e6-b8ab-66e8a7e84506 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:43.359132 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-593d07d0-22f2-4d3b-b4d9-d1735d58b1cf req-cc42b1cd-13fd-40e6-b8ab-66e8a7e84506 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:43.359623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-593d07d0-22f2-4d3b-b4d9-d1735d58b1cf req-cc42b1cd-13fd-40e6-b8ab-66e8a7e84506 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:43.371030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-593d07d0-22f2-4d3b-b4d9-d1735d58b1cf req-cc42b1cd-13fd-40e6-b8ab-66e8a7e84506 service nova] Creating event network-vif-deleted:425e5416-b421-4837-9184-b721b4762280 for instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 on hv-cinder-85919 Sep 24 15:03:43.376469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-593d07d0-22f2-4d3b-b4d9-d1735d58b1cf req-cc42b1cd-13fd-40e6-b8ab-66e8a7e84506 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032506 Sep 24 15:03:43.377067 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 302/585] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:43.443689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:43.444311 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:43.452483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:43.452980 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:43.454054 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:43.454773 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:43.455272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:43.455704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:43.710238 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:43.718544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-094b1338-2ccb-412a-8f8e-2ee4778096b8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.279597 Sep 24 15:03:43.719648 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 284/586] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:43 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:44.011479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0d44a8d8-1b44-4d74-b212-c4d12c866bb9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: .version_select at 0x7f7c10c060d0>, body: {"keypair": {"name": "tempest-keypair-1001382980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1BahYsbLuB3gzCDOBtDuWORrNB4ycs2bQmdSLG2XeSuiZWM0GQgdJtS2B/ZIcfBohxN5+sOkwH2ddfTxGs76CqTpWtt+MV1C6LRo02JezNNwA0xNeuu1ztfImh/6VkGA=="}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:44.026986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-0d44a8d8-1b44-4d74-b212-c4d12c866bb9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:03:44.030787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-0d44a8d8-1b44-4d74-b212-c4d12c866bb9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for user 9f74f51060554db18bc96199222e9261 and project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:03:44.052388 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0d44a8d8-1b44-4d74-b212-c4d12c866bb9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045050 Sep 24 15:03:44.052968 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 303/587] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:03:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:44.742736 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:44.743842 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:44.751051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:44.751543 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:44.752015 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:44.752724 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:44.753252 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:44.753684 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:44.983478 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:44.992503 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-43a3e24d-8684-4e4a-a426-6dac06b0075b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.253788 Sep 24 15:03:44.993109 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 285/588] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:44 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:45.394613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2113032933", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a01210a-747c-4b32-8123-27378a645fb5"}], "security_groups": [{"name": "tempest-securitygroup--1175791680"}], "key_name": "tempest-keypair-1001382980", "user_data": "}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:45.494506 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] validate_networks() for [('8a01210a-747c-4b32-8123-27378a645fb5', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:03:45.858240 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:03:45.858676 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:03:45.859176 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:03:45.859579 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:03:45.859998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:03:45.869063 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:45.869553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:45.870027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:45.870772 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:45.871266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:45.871701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:45.888561 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:03:45.893234 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for user 9f74f51060554db18bc96199222e9261 and project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:03:45.904155 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:03:45.906577 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:03:45.953956 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-87b4612f-6e15-45b7-bb0c-d6fd142d2939 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564284 Sep 24 15:03:45.954620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 304/589] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:03:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:03:45.965678 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-84ec4374-5933-4cc7-afa2-d0e248697c5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:45.966442 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-84ec4374-5933-4cc7-afa2-d0e248697c5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:46.015093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:46.016330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:46.021306 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-84ec4374-5933-4cc7-afa2-d0e248697c5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:46.025696 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:46.026152 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:46.026602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:46.027350 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:46.027817 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:46.028255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:46.028911 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-84ec4374-5933-4cc7-afa2-d0e248697c5a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1242 microversion: 2.1 time: 0.067118 Sep 24 15:03:46.029594 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 286/590] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:45 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:46.166060 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:46.174873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e80a3d89-3315-4ecc-8d4a-4fcbbb9e3e12 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.164028 Sep 24 15:03:46.175443 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 305/591] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:46 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:47.052962 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:47.053600 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:47.060604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:47.061091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:47.061534 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:47.062251 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:47.063233 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:47.063692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:47.122495 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:47.130477 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-70ee23e9-86fb-4128-b5d7-bd526dda900c tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1246 microversion: 2.1 time: 0.081344 Sep 24 15:03:47.131040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 287/592] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:47 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:47.197795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:47.198354 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:47.200272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:47.205989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:47.206478 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:47.206914 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:47.207602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:47.208055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:47.208482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:47.334806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:47.343299 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-abfbab84-eade-4312-8ff6-d92f74d0a336 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.149368 Sep 24 15:03:47.343912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 306/593] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:47 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:48.153752 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:48.154313 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:48.161491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:48.162416 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:48.163221 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:48.164031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:48.164501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:48.164945 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:48.187027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:48.233231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:48.241781 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2b420084-9955-4c89-a495-bedd9f8cc380 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1294 microversion: 2.1 time: 0.091910 Sep 24 15:03:48.242397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 288/594] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:48 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:48.367861 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:48.368805 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:48.374916 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:48.375763 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:48.376454 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:48.377224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:48.377766 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:48.378289 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:48.558768 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:48.567533 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d8cf8b01-d450-47e6-b864-767a5be22754 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.204603 Sep 24 15:03:48.568111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 307/595] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:48 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:49.264631 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:49.265249 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:49.272488 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:49.273103 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:49.273543 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:49.274269 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:49.274735 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:49.275188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:49.411652 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:49.419621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e6d4f165-a113-4313-9c48-65bf20aebe07 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1368 microversion: 2.1 time: 0.158823 Sep 24 15:03:49.420266 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 289/596] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:49 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:49.591842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:49.592455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:49.599199 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:49.599698 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:49.600144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:49.600851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:49.601329 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:49.601764 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:49.783382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:49.791652 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9f196363-9fff-40d1-98aa-47d3275631d2 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.203731 Sep 24 15:03:49.792229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 308/597] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:49 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:49.911406 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-290a5719-bfb3-4f44-ab81-178e8e9cfdbe req-0e2ed8cd-f147-49ea-aec5-204b5c236a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad8e4f1-7caf-4e74-9f35-d2691ea22437", "tag": "e674f5c0-3170-44fd-8c8c-af2c88a274d9"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:49.923149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-290a5719-bfb3-4f44-ab81-178e8e9cfdbe req-0e2ed8cd-f147-49ea-aec5-204b5c236a18 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:49.924572 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-290a5719-bfb3-4f44-ab81-178e8e9cfdbe req-0e2ed8cd-f147-49ea-aec5-204b5c236a18 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:49.925110 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-290a5719-bfb3-4f44-ab81-178e8e9cfdbe req-0e2ed8cd-f147-49ea-aec5-204b5c236a18 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:49.936638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-290a5719-bfb3-4f44-ab81-178e8e9cfdbe req-0e2ed8cd-f147-49ea-aec5-204b5c236a18 service nova] Creating event network-changed:e674f5c0-3170-44fd-8c8c-af2c88a274d9 for instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 on hv-cinder-85919 Sep 24 15:03:49.942559 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-290a5719-bfb3-4f44-ab81-178e8e9cfdbe req-0e2ed8cd-f147-49ea-aec5-204b5c236a18 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036231 Sep 24 15:03:49.943152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 290/598] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:50.443306 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:50.443921 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:50.453677 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:50.454212 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:50.454690 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:50.455407 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:50.456181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:50.456324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:50.638272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:50.646797 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0dee4d78-3d7d-4c4a-9690-767e50f32cac tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1368 microversion: 2.1 time: 0.207164 Sep 24 15:03:50.647306 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 309/599] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:50 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:50.815416 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:50.816115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:50.822687 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:50.823174 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:50.823607 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:50.824293 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:50.824749 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:50.825173 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:50.952759 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:50.964077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4a961c90-a1df-4ea8-a7ea-ceb7398e691a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.153379 Sep 24 15:03:50.964661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 291/600] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:50 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:51.670497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:51.671109 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:51.677454 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:51.678075 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:51.678562 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:51.679343 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:51.679872 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:51.680381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:51.890143 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:51.898266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-eeff5852-866a-4e4e-a80c-694f958256af tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1368 microversion: 2.1 time: 0.231905 Sep 24 15:03:51.898864 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 310/601] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:51 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:51.990899 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:51.991557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:51.997886 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:51.998412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:51.998855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:51.999557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:52.000077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:52.001014 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:52.140667 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:52.148952 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6d3342b7-9531-4485-a157-f5b3d9f0a2fb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.162900 Sep 24 15:03:52.149521 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 292/602] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:51 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:52.920489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:52.921119 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:52.927267 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:52.927765 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:52.928218 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:52.928922 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:52.929388 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:52.929821 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:53.128856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:53.142798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d96420e4-a332-4dc8-8760-0f7345ff5f76 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1368 microversion: 2.1 time: 0.226107 Sep 24 15:03:53.143385 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 311/603] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:52 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:53.172645 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:53.173320 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:53.180003 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:53.180494 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:53.180937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:53.181635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:53.182135 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:53.182595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:53.306964 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:53.315807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-58fdb820-265c-460f-b704-10fe585d2905 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.147336 Sep 24 15:03:53.316380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 293/604] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:53 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:54.165382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:54.166067 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:54.172599 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:54.173095 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:54.173539 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:54.174268 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:54.174738 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:54.175173 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:54.179155 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:54.300327 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:54.307921 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-271bfbe1-b74d-4c39-92be-2707f2bd608f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1368 microversion: 2.1 time: 0.146379 Sep 24 15:03:54.308477 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 312/605] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:54 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:03:54.339327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:54.339888 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:54.346830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:54.347312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:54.347745 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:54.348431 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:54.348886 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:54.349310 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:54.475845 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:54.484025 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4861dd06-20aa-4815-964f-0f5da1440bd3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.148581 Sep 24 15:03:54.484609 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 294/606] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:54 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:55.330005 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:55.330623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:55.336553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:55.337045 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:55.337491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:55.338214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:55.338677 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:55.339264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:55.470152 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:55.477985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5c079ea2-f62c-4243-8db5-1ea3bc1169b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1368 microversion: 2.1 time: 0.151891 Sep 24 15:03:55.478568 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 313/607] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:55 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:55.507006 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:55.507627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:55.514057 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:55.514558 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:55.515006 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:55.516289 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:55.516758 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:55.517193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:55.646614 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:55.654691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b8b9236a-3d0f-4a11-8678-1138daa267bb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.151542 Sep 24 15:03:55.655268 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 295/608] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:55 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:56.500609 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:56.501248 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:56.503074 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:56.503732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=10 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:56.509651 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:56.510168 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:56.510610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:56.511304 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:56.511763 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:56.512298 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:56.643088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:56.651332 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c49ab985-157b-4be3-bc04-e0f77635a908 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1368 microversion: 2.1 time: 0.154562 Sep 24 15:03:56.651907 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 314/609] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:56 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:56.676981 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:56.677601 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:56.679577 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:03:56.685301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:56.685796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:56.686268 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:56.686984 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:56.687984 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:56.688430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:56.819328 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:56.828200 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-237e80a4-94c0-4c48-86e2-4aee9d38f935 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.155052 Sep 24 15:03:56.829229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 296/610] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:56 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:56.966175 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-ecb1d3f2-5e92-462b-8f6d-a7776910015f req-6050c46f-ce6e-45e1-961f-c997ef13b8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad8e4f1-7caf-4e74-9f35-d2691ea22437", "name": "network-vif-plugged", "status": "completed", "tag": "e674f5c0-3170-44fd-8c8c-af2c88a274d9"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:56.976473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-ecb1d3f2-5e92-462b-8f6d-a7776910015f req-6050c46f-ce6e-45e1-961f-c997ef13b8d8 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:56.976872 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-ecb1d3f2-5e92-462b-8f6d-a7776910015f req-6050c46f-ce6e-45e1-961f-c997ef13b8d8 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:56.977343 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-ecb1d3f2-5e92-462b-8f6d-a7776910015f req-6050c46f-ce6e-45e1-961f-c997ef13b8d8 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:56.990533 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-ecb1d3f2-5e92-462b-8f6d-a7776910015f req-6050c46f-ce6e-45e1-961f-c997ef13b8d8 service nova] Creating event network-vif-plugged:e674f5c0-3170-44fd-8c8c-af2c88a274d9 for instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 on hv-cinder-85919 Sep 24 15:03:56.995690 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-ecb1d3f2-5e92-462b-8f6d-a7776910015f req-6050c46f-ce6e-45e1-961f-c997ef13b8d8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033296 Sep 24 15:03:56.996283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 315/611] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:03:57.675254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:57.675882 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:57.682603 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:57.683145 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:57.683529 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:57.684229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:57.684693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:57.685124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:57.824379 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:57.833553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3a516f98-b15c-460f-ad69-d5ab70f85842 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1368 microversion: 2.1 time: 0.162435 Sep 24 15:03:57.834162 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 297/612] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:57 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:57.852627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:57.853325 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:57.859540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:57.860028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:57.860466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:57.861160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:57.861614 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:57.862076 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:57.991781 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:58.000046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-446f2af6-0a53-47d5-9c31-1f79a309995b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1735 microversion: 2.1 time: 0.151607 Sep 24 15:03:58.000615 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 316/613] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:57 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:58.855916 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:58.856529 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:58.862936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:58.863429 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:58.863867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:58.864812 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:58.865278 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:58.865707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:58.991073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:58.998618 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-52dbc217-9044-4df7-811d-935b216c1441 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1368 microversion: 2.1 time: 0.146630 Sep 24 15:03:58.999194 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 298/614] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:58 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:59.024751 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:59.025364 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:59.031896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:59.032394 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:59.032842 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:59.033542 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:59.034068 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:59.034511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:59.162704 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:59.170771 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-04f28ac1-a6a1-4754-9571-feb6fd01e371 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1715 microversion: 2.1 time: 0.150682 Sep 24 15:03:59.171334 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 317/615] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:59 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:03:59.280139 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:59.280646 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:59.295444 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:59.296017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:59.296476 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:59.297208 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:59.297656 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:59.298116 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:59.384888 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] HTTP exception thrown: Cannot 'detach_volume' instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 while it is in vm_state rescued Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Request method failure captured: Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments/2a214d6b-b485-4315-8301-7428515bb389 HTTP/1.1 Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxt12m9EHw1ReQ63WKJGwL5k_xJalUXAkM07UVpT_gYVE14GGtWlhtFZjR37QGL9ZSTflp04sedb--Ff7lrillLu8TRJCvsvmkZJBnSfPamnWIF6E1bx3fVmGjveqb9UTnDa3Z-BgzWTdRKD8e2K7l-mGDiyxT84bDwK6JwOGGWuwpM Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:03:59.386627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}] Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: db5a0bddb68047d68f0c2dd1af0cd57b Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:03:59.388346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Cannot 'detach_volume' instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 while it is in vm_state rescued Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'server_id': '4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5', 'id': '2a214d6b-b485-4315-8301-7428515bb389'} Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:03:59.389131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 while it is in vm_state rescued Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 while it is in vm_state rescued Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:03:59.390397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Returning 409 to user: Cannot 'detach_volume' instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 while it is in vm_state rescued {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:03:59.391930 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2466229e-86ab-4527-8b5f-b2d87a74265b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments/2a214d6b-b485-4315-8301-7428515bb389" status: 409 len: 152 microversion: 2.1 time: 0.111889 Sep 24 15:03:59.391930 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 299/616] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:03:59 2022] DELETE /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments/2a214d6b-b485-4315-8301-7428515bb389 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 15:03:59.397620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-29ee156f-b52d-4839-bcc1-ded100ac466e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:03:59.398204 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-29ee156f-b52d-4839-bcc1-ded100ac466e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:59.404116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-29ee156f-b52d-4839-bcc1-ded100ac466e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:59.404606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-29ee156f-b52d-4839-bcc1-ded100ac466e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:59.405044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-29ee156f-b52d-4839-bcc1-ded100ac466e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:59.405736 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-29ee156f-b52d-4839-bcc1-ded100ac466e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:59.406221 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-29ee156f-b52d-4839-bcc1-ded100ac466e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:59.406649 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-29ee156f-b52d-4839-bcc1-ded100ac466e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:59.471813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-29ee156f-b52d-4839-bcc1-ded100ac466e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "POST /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/action" status: 202 len: 0 microversion: 2.1 time: 0.077817 Sep 24 15:03:59.472450 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 318/617] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:03:59 2022] POST /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 15:03:59.480504 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:03:59.481120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:03:59.487677 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:59.488170 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:59.488613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:59.489304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:03:59.490058 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:03:59.490487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:03:59.622099 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:03:59.631341 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b776a96f-6b36-485b-a9df-032624d83302 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1723 microversion: 2.1 time: 0.154637 Sep 24 15:03:59.631897 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 300/618] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:03:59 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:00.022253 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:00.022962 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:00.029543 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:00.030146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:00.030500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:00.031694 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:00.032161 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:00.032596 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:00.226447 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:00.234394 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7a97923d-fea6-424c-8198-935f11e1eba2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1558 microversion: 2.1 time: 0.216364 Sep 24 15:04:00.235323 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 319/619] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:00 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:00.258343 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9a303c1f-7b77-479a-94c4-a6e86d05d68a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:00.258891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9a303c1f-7b77-479a-94c4-a6e86d05d68a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:00.266051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a303c1f-7b77-479a-94c4-a6e86d05d68a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:00.266552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a303c1f-7b77-479a-94c4-a6e86d05d68a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:00.266995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a303c1f-7b77-479a-94c4-a6e86d05d68a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:00.267706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a303c1f-7b77-479a-94c4-a6e86d05d68a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:00.268169 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a303c1f-7b77-479a-94c4-a6e86d05d68a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:00.268596 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a303c1f-7b77-479a-94c4-a6e86d05d68a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:00.353422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9a303c1f-7b77-479a-94c4-a6e86d05d68a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099150 Sep 24 15:04:00.354044 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 301/620] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Sep 24 15:04:00 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:00.654774 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:00.655881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:00.663157 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:00.663752 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:00.664458 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:00.665264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:00.666090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:00.666597 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:00.989420 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:00.999186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-050ee349-cf4e-48d1-a6d4-230c84340b55 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1723 microversion: 2.1 time: 0.348484 Sep 24 15:04:01.000998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 320/621] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:00 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:01.535507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-459ce1dd-dfc3-45e1-80eb-2ea577553e94 req-3c5d9dc3-0cb0-4544-ad82-8b19a77a8ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad8e4f1-7caf-4e74-9f35-d2691ea22437", "tag": "e674f5c0-3170-44fd-8c8c-af2c88a274d9"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:01.545062 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-459ce1dd-dfc3-45e1-80eb-2ea577553e94 req-3c5d9dc3-0cb0-4544-ad82-8b19a77a8ac1 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:01.545630 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-459ce1dd-dfc3-45e1-80eb-2ea577553e94 req-3c5d9dc3-0cb0-4544-ad82-8b19a77a8ac1 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:01.546188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-459ce1dd-dfc3-45e1-80eb-2ea577553e94 req-3c5d9dc3-0cb0-4544-ad82-8b19a77a8ac1 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:01.559421 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-459ce1dd-dfc3-45e1-80eb-2ea577553e94 req-3c5d9dc3-0cb0-4544-ad82-8b19a77a8ac1 service nova] Creating event network-changed:e674f5c0-3170-44fd-8c8c-af2c88a274d9 for instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 on hv-cinder-85919 Sep 24 15:04:01.564542 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-459ce1dd-dfc3-45e1-80eb-2ea577553e94 req-3c5d9dc3-0cb0-4544-ad82-8b19a77a8ac1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033924 Sep 24 15:04:01.565223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 302/622] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:02.024683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:02.025337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:02.031305 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:02.031798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:02.032238 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:02.032935 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:02.033399 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:02.033831 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:02.161084 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:02.169430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9a4d7029-eabe-4b78-9acb-20f1bf0972e3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1723 microversion: 2.1 time: 0.148654 Sep 24 15:04:02.170020 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 321/623] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:02 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:03.193149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:03.194435 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:03.201017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:03.201508 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:03.202004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:03.202710 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:03.203659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:03.204091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:03.345407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:03.353575 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1ae88d08-aec5-4cc0-a423-07a125c8ad00 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1723 microversion: 2.1 time: 0.164713 Sep 24 15:04:03.354170 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 303/624] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:03 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:04:04.376915 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:04.377532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:04.383475 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:04.383967 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:04.384415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:04.385111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:04.385580 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:04.386041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:04.561988 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:04.570642 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f63828ac-e521-4bf5-8f75-633214a47ed7 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1729 microversion: 2.1 time: 0.198072 Sep 24 15:04:04.571227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 322/625] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:04 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:04.599054 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bc439137-5519-466c-8fd0-6144119b2d03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:04.599633 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bc439137-5519-466c-8fd0-6144119b2d03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:04.606057 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc439137-5519-466c-8fd0-6144119b2d03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:04.606558 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc439137-5519-466c-8fd0-6144119b2d03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:04.607008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc439137-5519-466c-8fd0-6144119b2d03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:04.607728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc439137-5519-466c-8fd0-6144119b2d03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:04.608194 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc439137-5519-466c-8fd0-6144119b2d03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:04.608631 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc439137-5519-466c-8fd0-6144119b2d03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:04.703623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bc439137-5519-466c-8fd0-6144119b2d03 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108665 Sep 24 15:04:04.704816 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 304/626] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Sep 24 15:04:04 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:05.597531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-ab7c2bc7-ec8f-46ff-a38e-cf9e5d2214c7 req-6c79e2e3-1620-4aa9-a440-5a5298614dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5", "tag": "ce05ac73-d405-4dc3-bd9f-978a3684e962"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:05.611544 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-ab7c2bc7-ec8f-46ff-a38e-cf9e5d2214c7 req-6c79e2e3-1620-4aa9-a440-5a5298614dd0 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:05.612232 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-ab7c2bc7-ec8f-46ff-a38e-cf9e5d2214c7 req-6c79e2e3-1620-4aa9-a440-5a5298614dd0 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:05.612998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-ab7c2bc7-ec8f-46ff-a38e-cf9e5d2214c7 req-6c79e2e3-1620-4aa9-a440-5a5298614dd0 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:05.636127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-ab7c2bc7-ec8f-46ff-a38e-cf9e5d2214c7 req-6c79e2e3-1620-4aa9-a440-5a5298614dd0 service nova] Creating event network-changed:ce05ac73-d405-4dc3-bd9f-978a3684e962 for instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 on hv-cinder-85919 Sep 24 15:04:05.642277 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-ab7c2bc7-ec8f-46ff-a38e-cf9e5d2214c7 req-6c79e2e3-1620-4aa9-a440-5a5298614dd0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050749 Sep 24 15:04:05.643036 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 323/627] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:06.045631 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1338e641-eed0-40ad-b38c-5110804ccf42 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:06.046880 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1338e641-eed0-40ad-b38c-5110804ccf42 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:06.054180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1338e641-eed0-40ad-b38c-5110804ccf42 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:06.054902 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1338e641-eed0-40ad-b38c-5110804ccf42 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:06.055663 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1338e641-eed0-40ad-b38c-5110804ccf42 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:06.056663 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1338e641-eed0-40ad-b38c-5110804ccf42 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:06.057495 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1338e641-eed0-40ad-b38c-5110804ccf42 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:06.058452 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1338e641-eed0-40ad-b38c-5110804ccf42 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:06.092651 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1338e641-eed0-40ad-b38c-5110804ccf42 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments/627fa28b-b069-4d1b-8bd6-7aea8b1f1d52" status: 200 len: 194 microversion: 2.20 time: 0.051148 Sep 24 15:04:06.094473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 305/628] 10.222.0.61 () {60 vars in 1454 bytes} [Sat Sep 24 15:04:06 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments/627fa28b-b069-4d1b-8bd6-7aea8b1f1d52 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 15:04:06.176586 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:06.177382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:06.183764 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:06.184262 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:06.184873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:06.185725 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:06.186362 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:06.186964 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:06.277726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lazy-loading 'services' on Instance uuid 0b247c5c-f642-4bcf-9c60-4b993f241a74 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:04:06.357375 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8db33c36-8fba-419e-9260-f0cb69d6679e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments/627fa28b-b069-4d1b-8bd6-7aea8b1f1d52" status: 202 len: 0 microversion: 2.20 time: 0.184722 Sep 24 15:04:06.358388 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 324/629] 10.222.0.61 () {60 vars in 1457 bytes} [Sat Sep 24 15:04:06 2022] DELETE /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments/627fa28b-b069-4d1b-8bd6-7aea8b1f1d52 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:04:06.367708 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ac82c974-7bf0-47f3-816b-418178ade424 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:06.370417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ac82c974-7bf0-47f3-816b-418178ade424 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:06.376785 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac82c974-7bf0-47f3-816b-418178ade424 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:06.377592 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac82c974-7bf0-47f3-816b-418178ade424 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:06.378582 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac82c974-7bf0-47f3-816b-418178ade424 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:06.379508 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac82c974-7bf0-47f3-816b-418178ade424 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:06.380079 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac82c974-7bf0-47f3-816b-418178ade424 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:06.380679 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac82c974-7bf0-47f3-816b-418178ade424 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:06.414200 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ac82c974-7bf0-47f3-816b-418178ade424 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050767 Sep 24 15:04:06.415262 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 306/630] 10.222.0.61 () {60 vars in 1343 bytes} [Sat Sep 24 15:04:06 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 15:04:07.429798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-67a5c1d9-7828-40c0-b4d7-621e4e2583f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:07.432912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-67a5c1d9-7828-40c0-b4d7-621e4e2583f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:07.439459 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67a5c1d9-7828-40c0-b4d7-621e4e2583f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:07.440275 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67a5c1d9-7828-40c0-b4d7-621e4e2583f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:07.441115 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67a5c1d9-7828-40c0-b4d7-621e4e2583f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:07.442120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67a5c1d9-7828-40c0-b4d7-621e4e2583f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:07.442743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67a5c1d9-7828-40c0-b4d7-621e4e2583f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:07.443447 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67a5c1d9-7828-40c0-b4d7-621e4e2583f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:07.476483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-67a5c1d9-7828-40c0-b4d7-621e4e2583f5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052340 Sep 24 15:04:07.477153 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 325/631] 10.222.0.61 () {60 vars in 1343 bytes} [Sat Sep 24 15:04:07 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 15:04:07.662509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-9bc3e79e-0b57-4815-8a97-fcb2b0bd7508 req-c5c4ae51-a26d-4d43-88ba-fc8c6b1f467d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5", "tag": "ce05ac73-d405-4dc3-bd9f-978a3684e962"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:07.672950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-9bc3e79e-0b57-4815-8a97-fcb2b0bd7508 req-c5c4ae51-a26d-4d43-88ba-fc8c6b1f467d service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:07.673433 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-9bc3e79e-0b57-4815-8a97-fcb2b0bd7508 req-c5c4ae51-a26d-4d43-88ba-fc8c6b1f467d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:07.673847 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-9bc3e79e-0b57-4815-8a97-fcb2b0bd7508 req-c5c4ae51-a26d-4d43-88ba-fc8c6b1f467d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:07.678354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:07.686199 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-9bc3e79e-0b57-4815-8a97-fcb2b0bd7508 req-c5c4ae51-a26d-4d43-88ba-fc8c6b1f467d service nova] Creating event network-changed:ce05ac73-d405-4dc3-bd9f-978a3684e962 for instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 on hv-cinder-85919 Sep 24 15:04:07.691126 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-9bc3e79e-0b57-4815-8a97-fcb2b0bd7508 req-c5c4ae51-a26d-4d43-88ba-fc8c6b1f467d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032632 Sep 24 15:04:07.691939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 307/632] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:04:08.490365 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bba4b24d-b637-4f94-8346-3b97aafe8b32 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:08.493352 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bba4b24d-b637-4f94-8346-3b97aafe8b32 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:08.500187 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bba4b24d-b637-4f94-8346-3b97aafe8b32 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:08.500982 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bba4b24d-b637-4f94-8346-3b97aafe8b32 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:08.501627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bba4b24d-b637-4f94-8346-3b97aafe8b32 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:08.502613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bba4b24d-b637-4f94-8346-3b97aafe8b32 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:08.503307 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bba4b24d-b637-4f94-8346-3b97aafe8b32 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:08.503815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bba4b24d-b637-4f94-8346-3b97aafe8b32 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:08.535089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bba4b24d-b637-4f94-8346-3b97aafe8b32 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049832 Sep 24 15:04:08.536244 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 326/633] 10.222.0.61 () {60 vars in 1343 bytes} [Sat Sep 24 15:04:08 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:08.608807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:08.610704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:08.618956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:08.619762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:08.620859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:08.621813 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:08.622517 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:08.623149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:08.654411 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:04:08.757667 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fb1575d2-2dc5-4073-bdb2-ace3528dc86f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 204 len: 0 microversion: 2.20 time: 0.153594 Sep 24 15:04:08.761680 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 308/634] 10.222.0.61 () {60 vars in 1280 bytes} [Sat Sep 24 15:04:08 2022] DELETE /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 15:04:08.767532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:08.768152 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:08.774473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:08.774964 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:08.775405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:08.776113 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:08.776568 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:08.777179 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:09.070675 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:09.078689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:09.080371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:09.081530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-87b0317d-3fee-4900-a353-a35e8af61be8 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.318809 Sep 24 15:04:09.082123 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 327/635] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:08 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:10.110127 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:10.112195 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:10.122389 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:10.124423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:10.126381 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:10.129062 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:10.129831 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:10.131670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:10.299480 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:10.308680 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:10.310398 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:10.311721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bb1d93ba-6dd0-409c-a3e5-3dd0dd17b5b1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.208076 Sep 24 15:04:10.312522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 309/636] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:10 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:11.338270 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:11.338890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:11.347442 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:11.347846 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:11.348381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:11.350545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:11.351455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:11.352251 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:11.380490 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:11.684765 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:11.696838 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:11.698411 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:11.699598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-dd837803-e411-4954-a386-9dbac3534e06 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1726 microversion: 2.20 time: 0.366791 Sep 24 15:04:11.700153 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 328/637] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:11 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1726 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:12.696774 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-78ab661a-7ceb-40c4-9792-9e28de54b555 req-42872d67-7dfc-43c6-98a8-5d6f91780a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b247c5c-f642-4bcf-9c60-4b993f241a74", "name": "network-vif-deleted", "tag": "4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:12.703050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:12.710922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-78ab661a-7ceb-40c4-9792-9e28de54b555 req-42872d67-7dfc-43c6-98a8-5d6f91780a11 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:12.711662 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-78ab661a-7ceb-40c4-9792-9e28de54b555 req-42872d67-7dfc-43c6-98a8-5d6f91780a11 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:12.712292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-78ab661a-7ceb-40c4-9792-9e28de54b555 req-42872d67-7dfc-43c6-98a8-5d6f91780a11 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:12.729980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:12.731348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:12.740148 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:12.742865 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:12.743584 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:12.744337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:12.744804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:12.745240 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:12.757077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-78ab661a-7ceb-40c4-9792-9e28de54b555 req-42872d67-7dfc-43c6-98a8-5d6f91780a11 service nova] Creating event network-vif-deleted:4a12ba8f-d9a1-4371-96f0-cdbf4ee0aa67 for instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 on hv-cinder-85919 Sep 24 15:04:12.771524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-78ab661a-7ceb-40c4-9792-9e28de54b555 req-42872d67-7dfc-43c6-98a8-5d6f91780a11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078624 Sep 24 15:04:12.772257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 310/638] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:12.859975 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:12.868866 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:12.870342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:12.871585 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-02c399b8-c569-42a6-a480-b4309caece43 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 200 len: 1367 microversion: 2.20 time: 0.145563 Sep 24 15:04:12.872270 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 329/639] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:12 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:13.900422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:13.902238 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:13.914578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:13.915971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:13.916390 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:13.917439 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:13.917940 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:13.918573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:13.936299 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] HTTP exception thrown: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Request method failure captured: Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 HTTP/1.1 Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxtzwCvVwOnNOWLZxYO9KOp0CZ6HLnItxmEaFGvNQAkwpiP1M5KLatXw_G_kfbZHvvxOCLz-uuO6XNNOCE_CNeZ0Lnh_e4TCLH6WHgjIQoKZQeCpHZAJgWaCCFz6yaPT9DMawDERIXBp--9G50u27PcXej1U1I9khxeYA6JvVImt7qI Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:04:13.938625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea560f6e50034738b03e588ada15e940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea560f6e50034738b03e588ada15e940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}] Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: cdbc898ffd4f4d5d87c3684fcc17313d Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:04:13.940059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '0b247c5c-f642-4bcf-9c60-4b993f241a74'} Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:04:13.940841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:04:13.942033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:04:13.945643 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Returning 404 to user: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:04:13.946775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-698617b3-b945-4318-b369-0bf6b51838f6 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 404 len: 111 microversion: 2.20 time: 0.053253 Sep 24 15:04:13.948233 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 311/640] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:13 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 15:04:13.957608 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9a03c054-50ff-4cd0-b5df-57213b12873b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '.version_select at 0x7f7c10bb9e50>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:13.996757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9a03c054-50ff-4cd0-b5df-57213b12873b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598955397" status: 204 len: 0 microversion: 2.20 time: 0.043999 Sep 24 15:04:13.999569 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 330/641] 10.222.0.61 () {60 vars in 1262 bytes} [Sat Sep 24 15:04:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598955397 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 15:04:15.243499 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d84aead4-fcc9-455c-81ec-79394ef1e31a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'create', calling method: .version_select at 0x7f7c10a8bca0>, body: {"keypair": {"name": "tempest-keypair-319960541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNK8ur4cHf9kv/kJUAOsmvokytjfdC+Dy5i+vIn7swK5aCoXur8lWnp1423AKu+A0AttvbqiWbLXAdyIzCo332yTpyTbwuZ+s+QzOr0GIxQwr4oPReOQFfO1uYNrfXQv3g=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:15.266744 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-d84aead4-fcc9-455c-81ec-79394ef1e31a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Getting quotas for project ea560f6e50034738b03e588ada15e940. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:04:15.272178 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-d84aead4-fcc9-455c-81ec-79394ef1e31a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Getting quotas for user cdbc898ffd4f4d5d87c3684fcc17313d and project ea560f6e50034738b03e588ada15e940. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:04:15.304759 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d84aead4-fcc9-455c-81ec-79394ef1e31a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.068041 Sep 24 15:04:15.305482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 312/642] 10.222.0.61 () {62 vars in 1200 bytes} [Sat Sep 24 15:04:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 15:04:17.644029 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1058762634", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "584d4e28-f5e4-4c8e-b2b6-d79b1d6a84f9"}], "security_groups": [{"name": "tempest-securitygroup--1277484497"}], "key_name": "tempest-keypair-319960541", "user_data": "}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:17.678037 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:17.810833 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] validate_networks() for [('584d4e28-f5e4-4c8e-b2b6-d79b1d6a84f9', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:04:18.355791 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:04:18.356183 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:04:18.356870 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:04:18.357607 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:04:18.358314 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:04:18.374001 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:18.374532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:18.375043 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:18.375863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:18.376324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:18.377425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:18.396265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Getting quotas for project ea560f6e50034738b03e588ada15e940. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:04:18.400627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Getting quotas for user cdbc898ffd4f4d5d87c3684fcc17313d and project ea560f6e50034738b03e588ada15e940. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:04:18.415378 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:04:18.420197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:04:18.489002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-63edc389-4943-4d0a-9bb1-ae073ede237f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.849801 Sep 24 15:04:18.489607 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 331/643] 10.222.0.61 () {62 vars in 1188 bytes} [Sat Sep 24 15:04:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 24 15:04:18.502852 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e06027e5-36f4-4c42-8645-e980a42bd939 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:18.503458 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e06027e5-36f4-4c42-8645-e980a42bd939 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:18.581963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e06027e5-36f4-4c42-8645-e980a42bd939 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:18.592214 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e06027e5-36f4-4c42-8645-e980a42bd939 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:18.600046 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e06027e5-36f4-4c42-8645-e980a42bd939 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:18.603617 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e06027e5-36f4-4c42-8645-e980a42bd939 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1281 microversion: 2.20 time: 0.106355 Sep 24 15:04:18.605439 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 313/644] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:18 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1281 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:04:19.628507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:19.629122 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:19.635659 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:19.636149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:19.636754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:19.637616 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:19.638256 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:19.638839 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:19.717409 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:19.728606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:19.733992 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:19.735417 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a288bc58-21b7-45ff-a6aa-0fee6bbaaff1 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1333 microversion: 2.20 time: 0.110808 Sep 24 15:04:19.754664 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 332/645] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:19 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:20.763901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:20.764534 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:20.776017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:20.776798 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:20.777578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:20.779196 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:20.783957 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:20.784530 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:20.908704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:20.919641 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:20.929160 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:20.930655 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-670ac827-e172-4b13-8307-75c509c7af0c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1339 microversion: 2.20 time: 0.170684 Sep 24 15:04:20.931757 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 314/646] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:20 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:21.960599 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:21.961233 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:21.974600 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:21.975160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:21.975604 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:21.976344 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:21.976801 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:21.977226 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:22.205673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:22.214236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:22.216319 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:22.217708 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-247dd0b2-7b07-4048-a469-faf4fa41ff85 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1407 microversion: 2.20 time: 0.261037 Sep 24 15:04:22.219160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 333/647] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:21 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:22.564693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-93935da1-044e-4c4d-95e9-6247610c5670 req-28709f09-374f-4514-be01-5b8dc7760df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f0888f-6da8-42cb-826c-506383e4bd08", "tag": "63e76081-8d75-427d-84e4-cb30841ec95f"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:22.589821 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-93935da1-044e-4c4d-95e9-6247610c5670 req-28709f09-374f-4514-be01-5b8dc7760df4 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:22.590355 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-93935da1-044e-4c4d-95e9-6247610c5670 req-28709f09-374f-4514-be01-5b8dc7760df4 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:22.590783 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-93935da1-044e-4c4d-95e9-6247610c5670 req-28709f09-374f-4514-be01-5b8dc7760df4 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:22.606229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-93935da1-044e-4c4d-95e9-6247610c5670 req-28709f09-374f-4514-be01-5b8dc7760df4 service nova] Creating event network-changed:63e76081-8d75-427d-84e4-cb30841ec95f for instance a4f0888f-6da8-42cb-826c-506383e4bd08 on hv-cinder-85919 Sep 24 15:04:22.612805 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-93935da1-044e-4c4d-95e9-6247610c5670 req-28709f09-374f-4514-be01-5b8dc7760df4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051854 Sep 24 15:04:22.613656 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 315/648] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:23.250655 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:23.251674 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:23.260179 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:23.260705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:23.261159 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:23.261926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:23.262910 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:23.263415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:23.405370 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:23.413767 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:23.415308 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:23.416419 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-aa1e7515-2b86-4125-8dd0-5b347f72bb62 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1407 microversion: 2.20 time: 0.171674 Sep 24 15:04:23.417458 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 334/649] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:23 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:24.444976 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:24.446475 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:24.453992 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:24.454855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:24.455375 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:24.456176 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:24.456844 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:24.457477 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:24.653562 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:24.663390 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:24.665490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:24.666886 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4971f867-312d-464e-9a7d-ece0f94f9df4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1407 microversion: 2.20 time: 0.227063 Sep 24 15:04:24.667692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 316/650] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:24 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:25.696852 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:25.698178 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:25.704684 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:25.705263 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:25.705777 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:25.706558 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:25.707231 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:25.707890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:25.855605 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:25.864531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:25.866262 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:25.867368 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-36c5de55-7014-4323-9b22-a66706485345 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1407 microversion: 2.20 time: 0.175210 Sep 24 15:04:25.868154 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 335/651] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:25 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:04:26.893094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:26.893640 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:26.900474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:26.900864 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:26.901308 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:26.902073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:26.902845 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:26.902956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:27.059221 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:27.069398 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:27.070242 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:27.071615 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0f06b1ba-508c-4e46-b97e-8e6f7f2f0f7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1407 microversion: 2.20 time: 0.182601 Sep 24 15:04:27.086889 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 317/652] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:26 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:28.097545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:28.098384 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:28.104668 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:28.105173 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:28.105615 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:28.106396 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:28.106866 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:28.107300 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:28.248095 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:28.259207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:28.260631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:28.262060 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7ccae3b3-1eeb-4c3d-a107-d823122fb104 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1407 microversion: 2.20 time: 0.168737 Sep 24 15:04:28.273930 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 336/653] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:28 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:29.082986 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-dd865da9-f002-4bf1-9ffc-2633fcd80c31 req-f85713a3-c24f-486b-a3bc-6da2d6ee3743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f0888f-6da8-42cb-826c-506383e4bd08", "name": "network-vif-plugged", "status": "completed", "tag": "63e76081-8d75-427d-84e4-cb30841ec95f"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:29.094278 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:29.098934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dd865da9-f002-4bf1-9ffc-2633fcd80c31 req-f85713a3-c24f-486b-a3bc-6da2d6ee3743 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:29.099430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dd865da9-f002-4bf1-9ffc-2633fcd80c31 req-f85713a3-c24f-486b-a3bc-6da2d6ee3743 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:29.100675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-dd865da9-f002-4bf1-9ffc-2633fcd80c31 req-f85713a3-c24f-486b-a3bc-6da2d6ee3743 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:29.115614 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-dd865da9-f002-4bf1-9ffc-2633fcd80c31 req-f85713a3-c24f-486b-a3bc-6da2d6ee3743 service nova] Creating event network-vif-plugged:63e76081-8d75-427d-84e4-cb30841ec95f for instance a4f0888f-6da8-42cb-826c-506383e4bd08 on hv-cinder-85919 Sep 24 15:04:29.121542 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-dd865da9-f002-4bf1-9ffc-2633fcd80c31 req-f85713a3-c24f-486b-a3bc-6da2d6ee3743 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043397 Sep 24 15:04:29.122530 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 318/654] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:29.156866 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c31a4cd4-a807-4e01-9818-2fdbc180d3a2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Action: 'create', calling method: .version_select at 0x7f7c10bb9430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1464457337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlx1ZSX8t2YI2j6QwRavYbKnCAnmidsMOVerT8L8NpfLxGFx1uAEtL7XIhSIiewQClECBkiUe8ZLhFDc/+VXGt+PD7zMnbrRlKSrRb+5WVjSG+WwhqBkSUOK5oEsNVsIw=="}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:29.162355 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:29.163033 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=6 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:29.174303 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-c31a4cd4-a807-4e01-9818-2fdbc180d3a2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Getting quotas for project 1afc2cc56fef4d5aa0e0905ef059d123. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:04:29.178082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-c31a4cd4-a807-4e01-9818-2fdbc180d3a2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Getting quotas for user 4e9a50200076443d98841a76e961408b and project 1afc2cc56fef4d5aa0e0905ef059d123. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:04:29.201013 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c31a4cd4-a807-4e01-9818-2fdbc180d3a2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047840 Sep 24 15:04:29.201773 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 337/655] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:04:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:29.288261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:29.289372 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:29.297364 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:29.298012 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:29.298527 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:29.299177 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:29.299639 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:29.300070 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:29.317830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-532469535", "imageRef": "ac55bc6e-0ee6-416d-8521-c65aecdcdafe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1464457337", "networks": [{"uuid": "1848b731-d525-4078-a58a-a58c5758a311"}]}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:29.379165 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] validate_networks() for [('1848b731-d525-4078-a58a-a58c5758a311', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:04:29.435939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:29.444756 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:29.446287 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:29.447516 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fdea8e08-c0d0-44e7-89b1-88ead00c99f4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1407 microversion: 2.20 time: 0.163864 Sep 24 15:04:29.447983 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 319/656] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:29 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:29.776344 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:04:29.776773 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:04:29.777252 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:04:29.777703 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:04:29.778154 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:04:29.786928 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:29.787418 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:29.787857 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:29.788583 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:29.789046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:29.789476 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:29.806190 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Getting quotas for project 1afc2cc56fef4d5aa0e0905ef059d123. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:04:29.810047 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Getting quotas for user 4e9a50200076443d98841a76e961408b and project 1afc2cc56fef4d5aa0e0905ef059d123. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:04:29.821553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:04:29.823668 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ac55bc6e-0ee6-416d-8521-c65aecdcdafe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:04:29.869933 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d1634aee-287d-4cfa-aff6-736191dd303f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557913 Sep 24 15:04:29.870595 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 338/657] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:04:29.881552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ecb5bc81-cd6f-4f1c-b22e-b8506fbe2f20 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:29.882209 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ecb5bc81-cd6f-4f1c-b22e-b8506fbe2f20 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:29.934976 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ecb5bc81-cd6f-4f1c-b22e-b8506fbe2f20 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:29.942208 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ecb5bc81-cd6f-4f1c-b22e-b8506fbe2f20 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1258 microversion: 2.1 time: 0.064419 Sep 24 15:04:29.942781 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 320/658] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:29 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:04:30.473038 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:30.473658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:30.479640 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:30.480135 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:30.480578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:30.481284 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:30.481746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:30.482210 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:30.614823 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:30.623038 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:30.624964 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:30.626100 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d0478a2d-6db2-45bb-b1d0-670fd657d58b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1407 microversion: 2.20 time: 0.157004 Sep 24 15:04:30.626655 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 339/659] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:30 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:30.964706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:30.965552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:30.971961 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:30.972442 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:30.972889 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:30.973581 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:30.974079 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:30.974512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:31.037952 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:31.045672 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e857dc1f-f8bd-4d67-b08d-330cfcf0397b tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1310 microversion: 2.1 time: 0.084898 Sep 24 15:04:31.046851 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 321/660] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:30 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:31.651601 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:31.652197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:31.658560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:31.659051 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:31.659495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:31.660193 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:31.660652 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:31.661083 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:31.794382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:31.802582 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:31.804032 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:31.805200 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e79dc6cf-91d7-4418-a084-109ed5a69a69 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1600 microversion: 2.20 time: 0.157604 Sep 24 15:04:31.817999 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 340/661] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:04:31 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:04:31.830864 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0cbc8c08-28c8-47ca-b3ed-3d8317ce3c4e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:31.831454 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0cbc8c08-28c8-47ca-b3ed-3d8317ce3c4e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:31.837743 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cbc8c08-28c8-47ca-b3ed-3d8317ce3c4e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:31.838335 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cbc8c08-28c8-47ca-b3ed-3d8317ce3c4e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:31.838975 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cbc8c08-28c8-47ca-b3ed-3d8317ce3c4e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:31.839856 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cbc8c08-28c8-47ca-b3ed-3d8317ce3c4e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:31.840318 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cbc8c08-28c8-47ca-b3ed-3d8317ce3c4e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:31.840747 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0cbc8c08-28c8-47ca-b3ed-3d8317ce3c4e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:31.922337 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0cbc8c08-28c8-47ca-b3ed-3d8317ce3c4e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096770 Sep 24 15:04:31.925941 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 322/662] 10.222.0.61 () {60 vars in 1316 bytes} [Sat Sep 24 15:04:31 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 15:04:32.070974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:32.071601 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:32.077935 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:32.078619 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:32.079273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:32.080226 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:32.080686 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:32.081278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:32.166994 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:32.180520 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-442d3d92-fd66-4cce-a478-0773d600923f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1316 microversion: 2.1 time: 0.115119 Sep 24 15:04:32.189953 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 341/663] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:32 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1316 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:33.203952 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:33.204814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:33.217323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:33.218193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:33.218590 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:33.219589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:33.222658 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:33.223615 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:33.508186 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:33.530141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-837cd075-33ae-4d65-bb5f-7922fdec1253 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.316302 Sep 24 15:04:33.530141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 323/664] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:33 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:33.563064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-2b34600c-d645-4fdf-85b6-b9161c26f5fb req-acd4a4b6-7adb-4ae6-b528-df44a216ac5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4f0888f-6da8-42cb-826c-506383e4bd08", "tag": "63e76081-8d75-427d-84e4-cb30841ec95f"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:33.574353 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-2b34600c-d645-4fdf-85b6-b9161c26f5fb req-acd4a4b6-7adb-4ae6-b528-df44a216ac5b service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:33.574770 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-2b34600c-d645-4fdf-85b6-b9161c26f5fb req-acd4a4b6-7adb-4ae6-b528-df44a216ac5b service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:33.575214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-2b34600c-d645-4fdf-85b6-b9161c26f5fb req-acd4a4b6-7adb-4ae6-b528-df44a216ac5b service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:33.608509 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-2b34600c-d645-4fdf-85b6-b9161c26f5fb req-acd4a4b6-7adb-4ae6-b528-df44a216ac5b service nova] Creating event network-changed:63e76081-8d75-427d-84e4-cb30841ec95f for instance a4f0888f-6da8-42cb-826c-506383e4bd08 on hv-cinder-85919 Sep 24 15:04:33.614703 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-2b34600c-d645-4fdf-85b6-b9161c26f5fb req-acd4a4b6-7adb-4ae6-b528-df44a216ac5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056292 Sep 24 15:04:33.615888 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 342/665] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:34.542349 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:34.542960 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:34.549472 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:34.550002 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:34.550526 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:34.551234 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:34.551700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:34.552205 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:34.743656 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:34.753689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4b96d88c-5164-4e7f-8e7d-93a21ad33fbc tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.214997 Sep 24 15:04:34.765696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 324/666] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:34 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:35.779781 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:35.780711 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:35.789578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:35.790107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:35.790556 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:35.791258 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:35.791712 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:35.792135 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:35.954697 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:35.972971 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bf85c0eb-0ea5-4cad-821d-3b67726e694e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.197985 Sep 24 15:04:35.988474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 343/667] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:35 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:36.996777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:36.997492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:37.004878 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:37.005374 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:37.005824 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:37.006777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:37.007247 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:37.007681 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:37.142359 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:37.150919 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-96f905fe-e98a-4dc3-9246-0232812f2611 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.158312 Sep 24 15:04:37.151579 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 325/668] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:36 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:38.173967 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:38.174590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:38.180979 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:38.181703 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:38.182334 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:38.183039 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:38.183547 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:38.183920 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:38.323177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:38.331949 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-dbf155c8-d96f-4101-9463-78c64e7ed4fd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.162026 Sep 24 15:04:38.332740 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 344/669] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:38 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:39.354408 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:39.355041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:39.361733 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:39.362268 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:39.362714 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:39.363522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:39.363910 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:39.364329 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:39.367811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:39.520853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:39.528568 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ca1d7fb7-c7eb-42ca-932f-5507b695d987 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.177976 Sep 24 15:04:39.529134 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 326/670] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:39 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:40.551845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:40.552573 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:40.554635 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:40.555530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=10 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:40.561484 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:40.562015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:40.562468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:40.563186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:40.563689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:40.564248 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:40.694894 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:40.703455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fbeeac4d-ae81-4afa-9981-45434fec3dac tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.155398 Sep 24 15:04:40.704006 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 345/671] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:40 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:41.726204 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:41.726833 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:41.728721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:41.735561 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:41.736061 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:41.736543 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:41.737304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:41.737786 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:41.738222 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:41.870451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:41.878845 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0bda8f7c-648c-4e10-9100-d48affdb1c84 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.156542 Sep 24 15:04:41.879511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 327/672] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:41 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:42.236739 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-028bfdaf-a76a-4acd-a0db-9cf48cbe3992 req-27648f9c-c7ae-4e8c-a3d4-1407a84d4c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27149a7e-4568-4ef5-889a-deae9c4c99f4", "tag": "e260da27-bebb-41f0-843b-c81f7ae57657"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:42.246492 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-028bfdaf-a76a-4acd-a0db-9cf48cbe3992 req-27648f9c-c7ae-4e8c-a3d4-1407a84d4c08 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:42.247024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-028bfdaf-a76a-4acd-a0db-9cf48cbe3992 req-27648f9c-c7ae-4e8c-a3d4-1407a84d4c08 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:42.247684 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-028bfdaf-a76a-4acd-a0db-9cf48cbe3992 req-27648f9c-c7ae-4e8c-a3d4-1407a84d4c08 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:42.252737 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=81 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:42.261382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-028bfdaf-a76a-4acd-a0db-9cf48cbe3992 req-27648f9c-c7ae-4e8c-a3d4-1407a84d4c08 service nova] Creating event network-changed:e260da27-bebb-41f0-843b-c81f7ae57657 for instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 on hv-cinder-85919 Sep 24 15:04:42.266267 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-028bfdaf-a76a-4acd-a0db-9cf48cbe3992 req-27648f9c-c7ae-4e8c-a3d4-1407a84d4c08 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033676 Sep 24 15:04:42.266873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 346/673] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:42.902272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:42.902927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:42.910094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:42.910588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:42.911028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:42.911720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:42.912179 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:42.912608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:43.049089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:43.057884 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cf757241-f68b-4e3a-9f71-c31f864b9123 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.159642 Sep 24 15:04:43.058483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 328/674] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:42 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:43.582498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:43.584181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:43.590362 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:43.590861 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:43.591331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:43.592033 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:43.592476 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:43.593414 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:43.680859 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lazy-loading 'services' on Instance uuid 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:04:43.751895 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1810c692-9a23-445d-a643-4b4516dd1bc1 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments/2a214d6b-b485-4315-8301-7428515bb389" status: 202 len: 0 microversion: 2.1 time: 0.175065 Sep 24 15:04:43.752487 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 347/675] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:04:43 2022] DELETE /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments/2a214d6b-b485-4315-8301-7428515bb389 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:04:43.761641 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cd99ff8e-1891-48c7-afe9-2342ed0dab4e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:43.763903 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cd99ff8e-1891-48c7-afe9-2342ed0dab4e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:43.770488 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd99ff8e-1891-48c7-afe9-2342ed0dab4e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:43.770935 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd99ff8e-1891-48c7-afe9-2342ed0dab4e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:43.771382 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd99ff8e-1891-48c7-afe9-2342ed0dab4e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:43.772082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd99ff8e-1891-48c7-afe9-2342ed0dab4e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:43.772544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd99ff8e-1891-48c7-afe9-2342ed0dab4e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:43.772977 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd99ff8e-1891-48c7-afe9-2342ed0dab4e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:43.810501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cd99ff8e-1891-48c7-afe9-2342ed0dab4e tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052943 Sep 24 15:04:43.811112 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 329/676] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:04:43 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:44.081537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:44.082205 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:44.088341 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:44.088836 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:44.089281 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:44.090013 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:44.090480 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:44.090914 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:44.219941 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:44.227463 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c352bd4d-6ecf-4837-94be-224ad4507760 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.150850 Sep 24 15:04:44.228037 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 348/677] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:44 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:44.823346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-05d38331-16ea-40c1-a364-b60e22171fe3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:44.825497 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-05d38331-16ea-40c1-a364-b60e22171fe3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:44.827821 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:44.834789 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05d38331-16ea-40c1-a364-b60e22171fe3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:44.835289 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05d38331-16ea-40c1-a364-b60e22171fe3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:44.835731 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05d38331-16ea-40c1-a364-b60e22171fe3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:44.836444 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05d38331-16ea-40c1-a364-b60e22171fe3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:44.837266 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05d38331-16ea-40c1-a364-b60e22171fe3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:44.837371 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05d38331-16ea-40c1-a364-b60e22171fe3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:44.869949 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-05d38331-16ea-40c1-a364-b60e22171fe3 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050551 Sep 24 15:04:44.870517 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 330/678] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:04:44 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:45.110457 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-362571ba-64b5-49fe-aaff-f25a48fe21f6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:45.110979 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-362571ba-64b5-49fe-aaff-f25a48fe21f6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:45.117085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362571ba-64b5-49fe-aaff-f25a48fe21f6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:45.117638 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362571ba-64b5-49fe-aaff-f25a48fe21f6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:45.118125 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362571ba-64b5-49fe-aaff-f25a48fe21f6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:45.118831 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362571ba-64b5-49fe-aaff-f25a48fe21f6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:45.119294 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362571ba-64b5-49fe-aaff-f25a48fe21f6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:45.119729 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362571ba-64b5-49fe-aaff-f25a48fe21f6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:45.142687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-362571ba-64b5-49fe-aaff-f25a48fe21f6 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/ips" status: 200 len: 150 microversion: 2.1 time: 0.036723 Sep 24 15:04:45.143268 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 349/679] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 15:04:45 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:45.252650 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:45.253552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:45.260583 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:45.261075 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:45.261516 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:45.262494 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:45.263124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:45.263560 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:45.414364 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:45.422989 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c595dc24-93b9-4b23-9fe4-a5ae70226cb2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.176659 Sep 24 15:04:45.430290 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 331/680] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:45 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:45.882848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-472b85d2-26c3-4610-bee3-9ccd00c32819 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:45.885036 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-472b85d2-26c3-4610-bee3-9ccd00c32819 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:45.891534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-472b85d2-26c3-4610-bee3-9ccd00c32819 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:45.892025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-472b85d2-26c3-4610-bee3-9ccd00c32819 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:45.892469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-472b85d2-26c3-4610-bee3-9ccd00c32819 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:45.893172 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-472b85d2-26c3-4610-bee3-9ccd00c32819 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:45.893643 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-472b85d2-26c3-4610-bee3-9ccd00c32819 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:45.894109 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-472b85d2-26c3-4610-bee3-9ccd00c32819 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:45.922634 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-472b85d2-26c3-4610-bee3-9ccd00c32819 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043826 Sep 24 15:04:45.923230 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 350/681] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:04:45 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 15:04:46.007290 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:46.007811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:46.013639 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:46.014164 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:46.014608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:46.015304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:46.015772 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:46.016202 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:46.040187 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:04:46.112363 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-52b7f865-d478-4592-8721-718237e9bd90 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 204 len: 0 microversion: 2.1 time: 0.108678 Sep 24 15:04:46.112942 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 332/682] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:04:46 2022] DELETE /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:04:46.123085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:46.123708 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:46.130232 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:46.130729 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:46.131175 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:46.131877 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:46.132345 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:46.132780 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:46.262242 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:46.269892 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8bc6bac6-afbe-45f3-a266-da079c0d107b tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1689 microversion: 2.1 time: 0.152301 Sep 24 15:04:46.270475 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 351/683] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:46 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:46.446434 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:46.447141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:46.453452 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:46.453964 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:46.454405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:46.455095 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:46.455548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:46.455971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:46.495661 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e753c86d-4493-4d91-bac4-2dcfd3cc8086 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c68cfb4b-996b-4c3a-8786-e786dd025f6c"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:46.498093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e753c86d-4493-4d91-bac4-2dcfd3cc8086 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:46.504056 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e753c86d-4493-4d91-bac4-2dcfd3cc8086 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:46.504562 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e753c86d-4493-4d91-bac4-2dcfd3cc8086 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:46.505003 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e753c86d-4493-4d91-bac4-2dcfd3cc8086 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:46.505714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e753c86d-4493-4d91-bac4-2dcfd3cc8086 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:46.506206 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e753c86d-4493-4d91-bac4-2dcfd3cc8086 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:46.506644 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e753c86d-4493-4d91-bac4-2dcfd3cc8086 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:46.590455 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:46.598684 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4cf3bd26-9e3d-4bf4-8cdd-ebd37296055c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.156461 Sep 24 15:04:46.599260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 333/684] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:46 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:47.174905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-7450ed05-7b29-474c-9a9c-f0093af08e0b req-53552fb0-389d-4b6f-9f08-b75daf4c0c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27149a7e-4568-4ef5-889a-deae9c4c99f4", "name": "network-vif-plugged", "status": "completed", "tag": "e260da27-bebb-41f0-843b-c81f7ae57657"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:47.184388 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-7450ed05-7b29-474c-9a9c-f0093af08e0b req-53552fb0-389d-4b6f-9f08-b75daf4c0c94 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:47.184878 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-7450ed05-7b29-474c-9a9c-f0093af08e0b req-53552fb0-389d-4b6f-9f08-b75daf4c0c94 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:47.185316 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-7450ed05-7b29-474c-9a9c-f0093af08e0b req-53552fb0-389d-4b6f-9f08-b75daf4c0c94 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:47.196646 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-7450ed05-7b29-474c-9a9c-f0093af08e0b req-53552fb0-389d-4b6f-9f08-b75daf4c0c94 service nova] Creating event network-vif-plugged:e260da27-bebb-41f0-843b-c81f7ae57657 for instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 on hv-cinder-85919 Sep 24 15:04:47.201423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-7450ed05-7b29-474c-9a9c-f0093af08e0b req-53552fb0-389d-4b6f-9f08-b75daf4c0c94 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 Sep 24 15:04:47.202037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 334/685] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:04:47.293094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:47.293835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:47.300641 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:47.301136 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:47.301632 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:47.302335 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:47.302805 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:47.303268 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:47.430569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:47.438260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6e8c7e91-7441-41a6-b54d-94e4a04102e4 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1689 microversion: 2.1 time: 0.149373 Sep 24 15:04:47.438832 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 335/686] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:47 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:04:47.621636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:47.622293 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:47.628661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:47.629150 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:47.629622 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:47.630337 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:47.630799 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:47.631238 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:47.762962 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:47.771100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cdd142d1-8d9c-4b2f-aa04-a394b478b9ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.153147 Sep 24 15:04:47.771673 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 336/687] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:47 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:04:48.461746 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:48.462511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:48.468344 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:48.468835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:48.469281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:48.470015 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:48.470485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:48.470919 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:48.598491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:48.606013 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-be4214e8-a5b6-4352-b1c2-77c18a0ef83c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1689 microversion: 2.1 time: 0.148082 Sep 24 15:04:48.606575 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 337/688] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:48 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:04:48.794163 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:48.794773 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:48.801686 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:48.802202 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:48.802635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:48.803319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:48.803765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:48.804194 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:48.935938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:48.943517 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-87c5f13a-4fb4-4dd8-979d-2e089e1955ba tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.153172 Sep 24 15:04:48.944090 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 338/689] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:48 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:04:49.630070 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:49.630792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:49.637435 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:49.637933 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:49.638384 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:49.639085 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:49.640220 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:49.640657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:49.771136 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:49.779071 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a4714219-1747-4ecc-8ba8-a6143edfdfc8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1689 microversion: 2.1 time: 0.152941 Sep 24 15:04:49.779668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 339/690] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:49 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:04:49.968373 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:49.968995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:49.975451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:49.975954 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:49.976399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:49.977100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:49.977568 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:49.978030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:50.110730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:50.118971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c0d604d8-1a57-43e1-8b43-9654e87fa454 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.154497 Sep 24 15:04:50.119653 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 340/691] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:49 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:50.198960 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e753c86d-4493-4d91-bac4-2dcfd3cc8086 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.707009 Sep 24 15:04:50.199490 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 352/692] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:04:46 2022] POST /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 194 bytes in 3708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:04:50.802034 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:50.802655 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:50.808629 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:50.809067 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:50.809512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:50.810232 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:50.810697 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:50.811133 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:50.941795 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:50.944141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:50.951017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0faf534e-d2a2-491f-8a04-a8fa43075925 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1689 microversion: 2.1 time: 0.152973 Sep 24 15:04:50.951584 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 341/693] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:50 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:51.141694 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:51.142433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:51.144333 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:04:51.150896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:51.151619 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:51.152255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:51.153144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:51.153605 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:51.154075 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:51.633649 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:51.642158 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b315e216-1112-4723-b8e0-35f11d38fe36 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1358 microversion: 2.1 time: 0.505106 Sep 24 15:04:51.654268 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 353/694] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:51 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1358 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:51.974592 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:51.976091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:51.983723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:51.984732 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:51.985173 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:51.986027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:51.986493 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:51.986922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:52.052544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:52.060443 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-266cfd71-9cd1-4e23-b088-d145087b591c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 200 len: 1622 microversion: 2.1 time: 0.089834 Sep 24 15:04:52.061256 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 342/695] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:51 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 1622 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:52.091252 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-4434de04-4417-442b-ae56-ef1ca25e59ee req-53bbe277-8515-4de5-be2c-7705379b2b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5", "name": "network-vif-deleted", "tag": "ce05ac73-d405-4dc3-bd9f-978a3684e962"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:52.102131 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-4434de04-4417-442b-ae56-ef1ca25e59ee req-53bbe277-8515-4de5-be2c-7705379b2b19 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:52.102621 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-4434de04-4417-442b-ae56-ef1ca25e59ee req-53bbe277-8515-4de5-be2c-7705379b2b19 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:52.103058 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-4434de04-4417-442b-ae56-ef1ca25e59ee req-53bbe277-8515-4de5-be2c-7705379b2b19 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:52.115520 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-4434de04-4417-442b-ae56-ef1ca25e59ee req-53bbe277-8515-4de5-be2c-7705379b2b19 service nova] Creating event network-vif-deleted:ce05ac73-d405-4dc3-bd9f-978a3684e962 for instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 on hv-cinder-85919 Sep 24 15:04:52.121031 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-4434de04-4417-442b-ae56-ef1ca25e59ee req-53bbe277-8515-4de5-be2c-7705379b2b19 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 Sep 24 15:04:52.122030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 354/696] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:52.666260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:52.666830 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:52.673499 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:52.674024 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:52.674466 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:52.675172 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:52.675634 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:52.676063 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:52.811406 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:52.819354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-93958fa1-33c5-4e21-a1f2-d329b8474d80 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1548 microversion: 2.1 time: 0.157050 Sep 24 15:04:52.819939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 343/697] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:52 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:52.853137 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:52.854213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:52.862252 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:52.863167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:52.863974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:52.864881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:52.865742 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:52.866536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:53.007107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:53.015202 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a1b66756-1df8-4d9b-8dd5-786e9207f37f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1548 microversion: 2.1 time: 0.176229 Sep 24 15:04:53.016335 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 355/698] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:52 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:53.039636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:53.044800 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:53.045692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Searching by: {'deleted': False, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123'} {{(pid=120591) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 15:04:53.053011 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:53.053503 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:53.054161 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:53.054899 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:53.055364 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:53.055800 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:53.084255 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:53.084871 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:53.091122 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:53.091621 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:53.092144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:53.092852 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:53.093346 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:53.093850 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:53.107386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] HTTP exception thrown: Instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 could not be found. Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Request method failure captured: Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 HTTP/1.1 Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxt12m9EHw1ReQ63WKJGwL5k_xJalUXAkM07UVpT_gYVE14GGtWlhtFZjR37QGL9ZSTflp04sedb--Ff7lrillLu8TRJCvsvmkZJBnSfPamnWIF6E1bx3fVmGjveqb9UTnDa3Z-BgzWTdRKD8e2K7l-mGDiyxT84bDwK6JwOGGWuwpM Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:04:53.109188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}] Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: db5a0bddb68047d68f0c2dd1af0cd57b Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 could not be found. Sep 24 15:04:53.110867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5'} Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 could not be found. Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:04:53.115435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 could not be found. Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 could not be found. Sep 24 15:04:53.116728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:04:53.117847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Returning 404 to user: Instance 4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:04:53.117847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c5bdc745-eee6-47e1-8a92-4285b900e5db tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5" status: 404 len: 111 microversion: 2.1 time: 0.030298 Sep 24 15:04:53.117847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 356/699] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:53 2022] GET /compute/v2.1/servers/4d1e5f21-2b41-4cdb-8d01-1d32345bcbf5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 15:04:53.119258 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-aefad1c7-54c7-43e0-a899-09ccb9608e89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '.version_select at 0x7f7c10b27040>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:53.138172 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-aefad1c7-54c7-43e0-a899-09ccb9608e89 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041096166" status: 202 len: 0 microversion: 2.1 time: 0.022547 Sep 24 15:04:53.142374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 357/700] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Sep 24 15:04:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041096166 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:04:53.154466 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.multi_cell_list [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120591) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 15:04:53.254310 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-49d5e960-1e40-41f2-a0c7-9928723aa750 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218554 Sep 24 15:04:53.255667 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 344/701] 10.222.0.61 () {58 vars in 1125 bytes} [Sat Sep 24 15:04:53 2022] GET /compute/v2.1/servers => generated 342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:53.267935 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:53.268550 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:53.275301 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:53.275780 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:53.276231 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:53.277133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:53.277581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:53.278067 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:53.665570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:53.673796 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0dbae932-4c49-4f3c-a694-6156e31aef57 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1548 microversion: 2.1 time: 0.410340 Sep 24 15:04:53.674389 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 358/702] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:53 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1548 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:55.260525 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-68f501a8-6407-4f09-84c8-ee30e78d16db tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c98bc0a2-cc4e-4bca-a28f-9bc829d7764a"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:55.263081 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-68f501a8-6407-4f09-84c8-ee30e78d16db tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:55.270530 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68f501a8-6407-4f09-84c8-ee30e78d16db tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:55.271028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68f501a8-6407-4f09-84c8-ee30e78d16db tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:55.271475 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68f501a8-6407-4f09-84c8-ee30e78d16db tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:55.272200 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68f501a8-6407-4f09-84c8-ee30e78d16db tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:55.272663 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68f501a8-6407-4f09-84c8-ee30e78d16db tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:55.273096 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68f501a8-6407-4f09-84c8-ee30e78d16db tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:55.647017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-68f501a8-6407-4f09-84c8-ee30e78d16db tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "POST /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390341 Sep 24 15:04:55.647653 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 345/703] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:04:55 2022] POST /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:04:56.137622 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:56.138141 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:56.144598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:56.145119 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:56.145554 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:56.146269 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:56.146726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:56.147150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:56.173725 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Going to try to terminate instance {{(pid=120590) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:04:56.245882 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ddbedbd3-35b1-4302-abbf-ba2aed0728a6 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 204 len: 0 microversion: 2.1 time: 0.111755 Sep 24 15:04:56.246479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 359/704] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:04:56 2022] DELETE /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:04:56.255680 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:56.256389 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:56.262468 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:56.263151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:56.263394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:56.264125 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:56.264588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:56.265020 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:56.394117 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:56.401820 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2c872ca2-562c-4a32-bfc6-6979466a88f8 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1506 microversion: 2.1 time: 0.150991 Sep 24 15:04:56.402418 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 346/705] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:56 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:04:57.425708 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:57.426464 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:57.433081 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:57.433574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:57.434059 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:57.434757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:57.435219 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:57.435659 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:57.562674 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:57.570180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e62aa750-d445-4616-84ca-8513efcfb33c tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1506 microversion: 2.1 time: 0.149251 Sep 24 15:04:57.570775 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 360/706] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:57 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:58.592567 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:58.593219 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:58.599829 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:58.600325 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:58.600772 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:58.601474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:58.601964 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:58.602402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:58.732498 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:04:58.741392 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-68b2f1bf-dbd7-42d4-b154-f521c7e8cafb tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1506 microversion: 2.1 time: 0.152626 Sep 24 15:04:58.741975 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 347/707] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:58 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:04:59.764160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:04:59.764795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:59.771593 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:59.772085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:59.772537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:59.773217 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:59.773957 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:59.774587 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:59.879752 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c68cfb4b-996b-4c3a-8786-e786dd025f6c"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:04:59.883488 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:04:59.896915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:59.897621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:59.898264 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:04:59.900514 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:04:59.903424 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:04:59.904054 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:00.033709 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:00.043497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c7c98a5f-3c49-47b7-9cdf-065d22812413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 200 len: 1506 microversion: 2.1 time: 0.283008 Sep 24 15:05:00.045883 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Invalid volume: volume c68cfb4b-996b-4c3a-8786-e786dd025f6c is already attached to instances: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: POST /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments HTTP/1.1 Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 74 Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:05:00.050794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {"volumeAttachment": {"volumeId": "c68cfb4b-996b-4c3a-8786-e786dd025f6c"}} Sep 24 15:05:00.052524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Invalid volume: volume c68cfb4b-996b-4c3a-8786-e786dd025f6c is already attached to instances: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'server_id': '4ad8e4f1-7caf-4e74-9f35-d2691ea22437', 'body': {'volumeAttachment': {'volumeId': 'c68cfb4b-996b-4c3a-8786-e786dd025f6c'}}} Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c68cfb4b-996b-4c3a-8786-e786dd025f6c is already attached to instances: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:00.053447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c68cfb4b-996b-4c3a-8786-e786dd025f6c is already attached to instances: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:00.054853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:05:00.056260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:05:00.056260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:05:00.056260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:05:00.056260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c68cfb4b-996b-4c3a-8786-e786dd025f6c is already attached to instances: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 Sep 24 15:05:00.056260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:00.057839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 400 to user: Invalid volume: volume c68cfb4b-996b-4c3a-8786-e786dd025f6c is already attached to instances: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:05:00.058606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 361/708] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:04:59 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:00.059170 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6325e2cc-dd34-4143-b0f5-006f1479696b tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.184015 Sep 24 15:05:00.064112 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 348/709] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:04:59 2022] POST /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 174 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 15:05:00.066687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-e9c61e09-f1bd-40d5-a114-f1a85c94f77f req-24660315-5d1f-4848-98b5-0b637ac6f95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f4ffe67-dbf1-42c6-9f36-30a0d09162b5", "name": "network-vif-deleted", "tag": "9d6f145d-02f2-4f5f-ae7a-1f247857e1af"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:00.076859 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-e9c61e09-f1bd-40d5-a114-f1a85c94f77f req-24660315-5d1f-4848-98b5-0b637ac6f95e service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:00.078146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-e9c61e09-f1bd-40d5-a114-f1a85c94f77f req-24660315-5d1f-4848-98b5-0b637ac6f95e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:00.078949 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-e9c61e09-f1bd-40d5-a114-f1a85c94f77f req-24660315-5d1f-4848-98b5-0b637ac6f95e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:00.091848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-e9c61e09-f1bd-40d5-a114-f1a85c94f77f req-24660315-5d1f-4848-98b5-0b637ac6f95e service nova] Creating event network-vif-deleted:9d6f145d-02f2-4f5f-ae7a-1f247857e1af for instance 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 on hv-cinder-85919 Sep 24 15:05:00.097946 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-e9c61e09-f1bd-40d5-a114-f1a85c94f77f req-24660315-5d1f-4848-98b5-0b637ac6f95e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037780 Sep 24 15:05:00.099316 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 362/710] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:00.149569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:00.150105 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:00.157398 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:00.157917 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:00.158364 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:00.159074 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:00.159582 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:00.160019 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:00.255570 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lazy-loading 'services' on Instance uuid 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:05:00.454352 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3a05021e-152f-4000-87f4-6004028e57c4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments/c68cfb4b-996b-4c3a-8786-e786dd025f6c" status: 202 len: 0 microversion: 2.1 time: 0.308626 Sep 24 15:05:00.454936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 349/711] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:05:00 2022] DELETE /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments/c68cfb4b-996b-4c3a-8786-e786dd025f6c => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:05:00.463802 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cba0cd0c-8817-4504-ae7b-6956761b3381 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:00.466056 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-cba0cd0c-8817-4504-ae7b-6956761b3381 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:00.472654 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cba0cd0c-8817-4504-ae7b-6956761b3381 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:00.473145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cba0cd0c-8817-4504-ae7b-6956761b3381 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:00.473592 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cba0cd0c-8817-4504-ae7b-6956761b3381 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:00.474338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cba0cd0c-8817-4504-ae7b-6956761b3381 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:00.474802 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cba0cd0c-8817-4504-ae7b-6956761b3381 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:00.475236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cba0cd0c-8817-4504-ae7b-6956761b3381 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:00.478868 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:00.505182 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-cba0cd0c-8817-4504-ae7b-6956761b3381 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045681 Sep 24 15:05:00.505732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 363/712] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:05:00 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:01.070144 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:01.070835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:01.076913 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:01.077396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:01.077857 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:01.078568 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:01.079024 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:01.079451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:01.092081 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] HTTP exception thrown: Instance 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 could not be found. Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Request method failure captured: Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 HTTP/1.1 Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxt12m9EHw1ReQ63WKJGwL5k_xJalUXAkM07UVpT_gYVE14GGtWlhtFZjR37QGL9ZSTflp04sedb--Ff7lrillLu8TRJCvsvmkZJBnSfPamnWIF6E1bx3fVmGjveqb9UTnDa3Z-BgzWTdRKD8e2K7l-mGDiyxT84bDwK6JwOGGWuwpM Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:05:01.093675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}] Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: db5a0bddb68047d68f0c2dd1af0cd57b Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 could not be found. Sep 24 15:05:01.095203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '2f4ffe67-dbf1-42c6-9f36-30a0d09162b5'} Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 could not be found. Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:05:01.096050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 could not be found. Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 could not be found. Sep 24 15:05:01.097569 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:01.098956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Returning 404 to user: Instance 2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:05:01.098956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cdd5f4eb-5839-4dfb-91bc-4d1273c5a049 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5" status: 404 len: 111 microversion: 2.1 time: 0.029546 Sep 24 15:05:01.098956 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 350/713] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:01 2022] GET /compute/v2.1/servers/2f4ffe67-dbf1-42c6-9f36-30a0d09162b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:05:01.103335 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:01.103838 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:01.110670 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:01.111157 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:01.111595 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:01.112286 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:01.112738 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:01.113165 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:01.138139 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Going to try to terminate instance {{(pid=120590) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:05:01.208956 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-cbc2357d-41bf-4d54-be6f-3b0963579b04 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "DELETE /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 204 len: 0 microversion: 2.1 time: 0.109079 Sep 24 15:05:01.209579 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 364/714] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:05:01 2022] DELETE /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:05:01.217584 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:01.218248 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:01.224147 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:01.224641 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:01.225088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:01.225787 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:01.226286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:01.226720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:01.357627 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:01.366276 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d4e3da67-cd85-4a2f-be84-3780aa413d23 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.152579 Sep 24 15:05:01.366849 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 351/715] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:01 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:01.518569 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fdc9ed37-d469-40ac-890f-0f067e44b922 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:01.520779 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fdc9ed37-d469-40ac-890f-0f067e44b922 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:01.526926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdc9ed37-d469-40ac-890f-0f067e44b922 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:01.527442 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdc9ed37-d469-40ac-890f-0f067e44b922 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:01.527892 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdc9ed37-d469-40ac-890f-0f067e44b922 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:01.528586 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdc9ed37-d469-40ac-890f-0f067e44b922 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:01.529050 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdc9ed37-d469-40ac-890f-0f067e44b922 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:01.529483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fdc9ed37-d469-40ac-890f-0f067e44b922 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:01.562098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fdc9ed37-d469-40ac-890f-0f067e44b922 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047762 Sep 24 15:05:01.562528 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 365/716] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:05:01 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:02.388551 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:02.389194 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:02.396668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:02.397151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:02.397642 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:02.398372 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:02.398829 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:02.399253 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:02.527222 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:02.534837 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-945dce30-88d6-446b-b805-aebf5e24a158 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.150197 Sep 24 15:05:02.535396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 352/717] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:02 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:02.574787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-38737bff-3ad7-4094-a9dd-6f9956ab98f7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:02.576902 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-38737bff-3ad7-4094-a9dd-6f9956ab98f7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:02.583243 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-38737bff-3ad7-4094-a9dd-6f9956ab98f7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:02.583745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-38737bff-3ad7-4094-a9dd-6f9956ab98f7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:02.584167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-38737bff-3ad7-4094-a9dd-6f9956ab98f7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:02.584854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-38737bff-3ad7-4094-a9dd-6f9956ab98f7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:02.585310 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-38737bff-3ad7-4094-a9dd-6f9956ab98f7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:02.585738 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-38737bff-3ad7-4094-a9dd-6f9956ab98f7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:02.614480 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-38737bff-3ad7-4094-a9dd-6f9956ab98f7 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Sep 24 15:05:02.615019 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 366/718] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:05:02 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:03.558066 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:03.558723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:03.560663 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:03.566337 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:03.566834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:03.567282 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:03.568023 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:03.568494 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:03.568931 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:03.627120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-177a8d0d-52c8-4f84-a310-d1472ed76737 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:03.629273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-177a8d0d-52c8-4f84-a310-d1472ed76737 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:03.635719 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-177a8d0d-52c8-4f84-a310-d1472ed76737 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:03.636209 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-177a8d0d-52c8-4f84-a310-d1472ed76737 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:03.636652 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-177a8d0d-52c8-4f84-a310-d1472ed76737 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:03.637349 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-177a8d0d-52c8-4f84-a310-d1472ed76737 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:03.637807 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-177a8d0d-52c8-4f84-a310-d1472ed76737 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:03.638270 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-177a8d0d-52c8-4f84-a310-d1472ed76737 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:03.667761 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-177a8d0d-52c8-4f84-a310-d1472ed76737 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Sep 24 15:05:03.668330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 367/719] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:05:03 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:05:03.700081 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:03.707900 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ff3ebcb8-f8dc-41fb-a207-6abd4641728d tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.153710 Sep 24 15:05:03.708507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 353/720] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:03 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:04.680813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d5cdaa17-1c60-43a3-a7e7-523e194b0fbb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:04.682973 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d5cdaa17-1c60-43a3-a7e7-523e194b0fbb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:04.689889 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa17-1c60-43a3-a7e7-523e194b0fbb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:04.690410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa17-1c60-43a3-a7e7-523e194b0fbb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:04.690850 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa17-1c60-43a3-a7e7-523e194b0fbb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:04.691545 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa17-1c60-43a3-a7e7-523e194b0fbb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:04.692003 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa17-1c60-43a3-a7e7-523e194b0fbb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:04.692434 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5cdaa17-1c60-43a3-a7e7-523e194b0fbb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:04.720674 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d5cdaa17-1c60-43a3-a7e7-523e194b0fbb tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Sep 24 15:05:04.721221 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 368/721] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:05:04 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:04.731375 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:04.731996 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:04.739008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:04.739589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:04.740510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:04.741356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:04.741870 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:04.742382 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:04.867621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:04.875343 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-af083903-3cfe-4f62-8997-444fc9388c29 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1521 microversion: 2.1 time: 0.147844 Sep 24 15:05:04.875905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 354/722] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:04 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:05.732775 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-dd517dd4-88df-4305-84ea-fbb845b53d2f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:05.735603 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-dd517dd4-88df-4305-84ea-fbb845b53d2f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:05.742971 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd517dd4-88df-4305-84ea-fbb845b53d2f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:05.743471 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd517dd4-88df-4305-84ea-fbb845b53d2f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:05.744110 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd517dd4-88df-4305-84ea-fbb845b53d2f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:05.744980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd517dd4-88df-4305-84ea-fbb845b53d2f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:05.745604 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd517dd4-88df-4305-84ea-fbb845b53d2f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:05.746062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd517dd4-88df-4305-84ea-fbb845b53d2f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:05.845649 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-dd517dd4-88df-4305-84ea-fbb845b53d2f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116719 Sep 24 15:05:05.846180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 369/723] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:05:05 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:05.871171 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-bd52f3c5-643c-4a47-8d81-005d7f886b72 req-1cec9762-ff41-49cc-be35-d543b1757d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1", "name": "network-vif-deleted", "tag": "6205a209-bcc7-49c3-a3c4-3b0450b789de"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:05.880877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bd52f3c5-643c-4a47-8d81-005d7f886b72 req-1cec9762-ff41-49cc-be35-d543b1757d49 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:05.881393 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bd52f3c5-643c-4a47-8d81-005d7f886b72 req-1cec9762-ff41-49cc-be35-d543b1757d49 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:05.881824 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-bd52f3c5-643c-4a47-8d81-005d7f886b72 req-1cec9762-ff41-49cc-be35-d543b1757d49 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:05.892490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-bd52f3c5-643c-4a47-8d81-005d7f886b72 req-1cec9762-ff41-49cc-be35-d543b1757d49 service nova] Creating event network-vif-deleted:6205a209-bcc7-49c3-a3c4-3b0450b789de for instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 on hv-cinder-85919 Sep 24 15:05:05.897329 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-bd52f3c5-643c-4a47-8d81-005d7f886b72 req-1cec9762-ff41-49cc-be35-d543b1757d49 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029826 Sep 24 15:05:05.897934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 355/724] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:05.898288 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:05.898943 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:05.904812 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:05.905314 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:05.906346 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:05.907053 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:05.907520 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:05.907957 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:05.973409 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:05.981092 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-52176bd4-ca6a-46fa-8e02-1597f1222413 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1479 microversion: 2.1 time: 0.087349 Sep 24 15:05:05.981651 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 370/725] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:05 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1479 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:06.858110 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-05dc73df-5843-45cc-be2b-b08d74c737b3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:06.860360 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-05dc73df-5843-45cc-be2b-b08d74c737b3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:06.866853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05dc73df-5843-45cc-be2b-b08d74c737b3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:06.867344 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05dc73df-5843-45cc-be2b-b08d74c737b3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:06.867788 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05dc73df-5843-45cc-be2b-b08d74c737b3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:06.868485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05dc73df-5843-45cc-be2b-b08d74c737b3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:06.868944 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05dc73df-5843-45cc-be2b-b08d74c737b3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:06.869374 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05dc73df-5843-45cc-be2b-b08d74c737b3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:06.899448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-05dc73df-5843-45cc-be2b-b08d74c737b3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045920 Sep 24 15:05:06.900040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 356/726] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:05:06 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:07.124019 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:07.125269 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:07.131215 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:07.131699 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:07.132138 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:07.132823 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:07.133283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:07.133718 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:07.168673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:07.169375 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:07.169816 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:07.170304 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lazy-loading 'fault' on Instance uuid 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:05:07.215938 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5a0bddb68047d68f0c2dd1af0cd57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578268f34d874bf9835e8ec4cb31ebee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:07.223988 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7686c2a0-075c-472e-a525-4ed4d489374a tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 200 len: 1312 microversion: 2.1 time: 0.218787 Sep 24 15:05:07.224562 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 371/727] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:07 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:07.516505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:07.517122 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:07.523490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:07.523993 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:07.524439 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:07.525143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:07.525740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:07.526423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:07.542641 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:07.667891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:07.677354 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-30743331-c69c-40f3-bfe9-09b5eed88f7e tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1594 microversion: 2.1 time: 0.164620 Sep 24 15:05:07.678171 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 357/728] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:07 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:07.912243 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c3178c68-81fe-4b48-b5da-e9fde603328a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:07.914521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c3178c68-81fe-4b48-b5da-e9fde603328a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:07.920606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3178c68-81fe-4b48-b5da-e9fde603328a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:07.921110 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3178c68-81fe-4b48-b5da-e9fde603328a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:07.921612 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3178c68-81fe-4b48-b5da-e9fde603328a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:07.922348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3178c68-81fe-4b48-b5da-e9fde603328a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:07.922835 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3178c68-81fe-4b48-b5da-e9fde603328a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:07.923241 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3178c68-81fe-4b48-b5da-e9fde603328a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:07.956415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c3178c68-81fe-4b48-b5da-e9fde603328a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048168 Sep 24 15:05:07.956976 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 372/729] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:05:07 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 15:05:08.027305 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:08.027841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:08.034794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:08.035289 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:08.035728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:08.036430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:08.036892 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:08.037327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:08.063737 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:05:08.145070 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ffa066c7-822e-4e9f-8875-171138150e87 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 204 len: 0 microversion: 2.1 time: 0.121149 Sep 24 15:05:08.145741 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 358/730] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:05:08 2022] DELETE /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:05:08.154088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:08.155321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:08.162331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:08.162825 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:08.163269 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:08.163970 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:08.164431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:08.164863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:08.247286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:08.248113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] [instance: 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:08.254074 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:08.254636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:08.255124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:08.255939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:08.256409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:08.256841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:08.271156 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] HTTP exception thrown: Instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 could not be found. Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Request method failure captured: Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 HTTP/1.1 Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxt12m9EHw1ReQ63WKJGwL5k_xJalUXAkM07UVpT_gYVE14GGtWlhtFZjR37QGL9ZSTflp04sedb--Ff7lrillLu8TRJCvsvmkZJBnSfPamnWIF6E1bx3fVmGjveqb9UTnDa3Z-BgzWTdRKD8e2K7l-mGDiyxT84bDwK6JwOGGWuwpM Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:05:08.272792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/578268f34d874bf9835e8ec4cb31ebee"}]}] Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 578268f34d874bf9835e8ec4cb31ebee Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-451095323 Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: db5a0bddb68047d68f0c2dd1af0cd57b Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-ServerRescueNegativeTestJSON-451095323-project Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 could not be found. Sep 24 15:05:08.274334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1'} Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 could not be found. Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:05:08.278726 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 could not be found. Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 could not be found. Sep 24 15:05:08.280348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:05:08.282217 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] Returning 404 to user: Instance 08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:05:08.282217 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6e1fb73b-0250-4948-ad4b-1e2dbca29687 tempest-ServerRescueNegativeTestJSON-451095323 tempest-ServerRescueNegativeTestJSON-451095323-project] 10.222.0.61 "GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1" status: 404 len: 111 microversion: 2.1 time: 0.031205 Sep 24 15:05:08.282217 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 359/731] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:08 2022] GET /compute/v2.1/servers/08c4f6b5-18e0-4aa7-b1e5-4536a78d13b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 15:05:08.376119 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:08.385113 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4e4e9e2a-dbdd-4b06-87c0-97ef2ddee24d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1683 microversion: 2.1 time: 0.234850 Sep 24 15:05:08.385986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 373/732] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:08 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1683 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:09.408698 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:09.410105 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:09.417002 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:09.417796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:09.418470 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:09.419188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:09.419657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:09.420089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:09.633722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-bc3dd94c-6aae-467a-a650-6ce137f3894c req-0132225c-f534-423c-9366-3fa8da5a437c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27149a7e-4568-4ef5-889a-deae9c4c99f4", "tag": "e260da27-bebb-41f0-843b-c81f7ae57657"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:09.652654 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-bc3dd94c-6aae-467a-a650-6ce137f3894c req-0132225c-f534-423c-9366-3fa8da5a437c service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:09.653242 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-bc3dd94c-6aae-467a-a650-6ce137f3894c req-0132225c-f534-423c-9366-3fa8da5a437c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:09.653927 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-bc3dd94c-6aae-467a-a650-6ce137f3894c req-0132225c-f534-423c-9366-3fa8da5a437c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:09.665643 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:09.691761 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a282c536-4908-4fdf-85c2-f0d7885755d3 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1683 microversion: 2.1 time: 0.286964 Sep 24 15:05:09.692397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 360/733] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:09 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1683 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:09.711045 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-bc3dd94c-6aae-467a-a650-6ce137f3894c req-0132225c-f534-423c-9366-3fa8da5a437c service nova] Creating event network-changed:e260da27-bebb-41f0-843b-c81f7ae57657 for instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 on hv-cinder-85919 Sep 24 15:05:09.718856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-bc3dd94c-6aae-467a-a650-6ce137f3894c req-0132225c-f534-423c-9366-3fa8da5a437c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087950 Sep 24 15:05:09.720928 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 374/734] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:05:10.718016 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:10.719361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:10.736473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:10.736965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:10.737406 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:10.738154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:10.738624 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:10.739050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:11.193489 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:11.203082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a0b988be-0e5f-43ac-a177-7c067a6c418e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1683 microversion: 2.1 time: 0.488291 Sep 24 15:05:11.204444 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 361/735] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:10 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1683 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:11.588734 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-221367362"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:11.589973 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:11.596693 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:11.597423 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:11.598110 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:11.599011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:11.599635 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:11.600229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:11.740262 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-36a8c865-1ace-42e8-8ef2-89ddf828e7ab req-fcd9c049-a79c-48a6-9848-4457d1b76bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad8e4f1-7caf-4e74-9f35-d2691ea22437", "name": "network-vif-deleted", "tag": "e674f5c0-3170-44fd-8c8c-af2c88a274d9"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:11.771153 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-36a8c865-1ace-42e8-8ef2-89ddf828e7ab req-fcd9c049-a79c-48a6-9848-4457d1b76bda service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:11.772123 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-36a8c865-1ace-42e8-8ef2-89ddf828e7ab req-fcd9c049-a79c-48a6-9848-4457d1b76bda service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:11.773022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-36a8c865-1ace-42e8-8ef2-89ddf828e7ab req-fcd9c049-a79c-48a6-9848-4457d1b76bda service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:11.789387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-36a8c865-1ace-42e8-8ef2-89ddf828e7ab req-fcd9c049-a79c-48a6-9848-4457d1b76bda service nova] Creating event network-vif-deleted:e674f5c0-3170-44fd-8c8c-af2c88a274d9 for instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 on hv-cinder-85919 Sep 24 15:05:11.803788 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-36a8c865-1ace-42e8-8ef2-89ddf828e7ab req-fcd9c049-a79c-48a6-9848-4457d1b76bda service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065969 Sep 24 15:05:11.804949 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 362/736] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:05:11.869497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.network.security_group_api [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Adding security group 8519b741-7242-45e6-b5df-9b6974f5bf09 to port e260da27-bebb-41f0-843b-c81f7ae57657 Sep 24 15:05:12.232707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:12.233412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:12.243097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:12.244301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:12.244749 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:12.245670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:12.246269 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:12.246987 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:12.281510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:12.282291 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:12.282910 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:12.283519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lazy-loading 'fault' on Instance uuid 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:05:12.356083 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:12.367939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2f6c8f59-8a7d-47ee-8a66-83de314b8f0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 200 len: 1332 microversion: 2.1 time: 0.139852 Sep 24 15:05:12.369782 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 363/737] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:12 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:05:12.441050 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1ae8ff2b-66c1-4d9f-8c5b-288c93e79ee3 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "POST /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/action" status: 202 len: 0 microversion: 2.1 time: 0.856708 Sep 24 15:05:12.443207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 375/738] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:05:11 2022] POST /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:05:12.456238 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:12.471666 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:12.491587 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:12.496702 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:12.497188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:12.500711 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:12.503427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:12.505528 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:12.744946 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:12.756814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f5dc8641-4969-41b6-a678-1c10920b97f2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1758 microversion: 2.1 time: 0.309378 Sep 24 15:05:12.758041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 364/739] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:12 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1758 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:13.395623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:13.397892 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:13.408301 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:13.408885 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:13.409754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:13.411314 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:13.412144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:13.412663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:13.427795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 HTTP/1.1 Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:05:13.431437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:05:13.432769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '4ad8e4f1-7caf-4e74-9f35-d2691ea22437'} Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:05:13.433879 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:05:13.435650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:05:13.439006 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:05:13.440145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f8ef4cc5-5222-47a0-bc69-67d67068c6e4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 404 len: 111 microversion: 2.1 time: 0.049995 Sep 24 15:05:13.440912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 376/740] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:13 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:05:13.449415 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7f1efbfb-9fff-476d-a34b-36c49035f536 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '.version_select at 0x7f7c1095eb80>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:13.470619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7f1efbfb-9fff-476d-a34b-36c49035f536 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001382980" status: 202 len: 0 microversion: 2.1 time: 0.024849 Sep 24 15:05:13.471208 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 365/741] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Sep 24 15:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001382980 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:05:13.831711 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-4e13db21-d0c7-4f38-8ba7-0b2bc3319198 req-f7a1ea11-82b2-4485-a6ad-9fceb5ff832d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27149a7e-4568-4ef5-889a-deae9c4c99f4", "tag": "e260da27-bebb-41f0-843b-c81f7ae57657"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:13.844225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-4e13db21-d0c7-4f38-8ba7-0b2bc3319198 req-f7a1ea11-82b2-4485-a6ad-9fceb5ff832d service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:13.844727 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-4e13db21-d0c7-4f38-8ba7-0b2bc3319198 req-f7a1ea11-82b2-4485-a6ad-9fceb5ff832d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:13.845643 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-4e13db21-d0c7-4f38-8ba7-0b2bc3319198 req-f7a1ea11-82b2-4485-a6ad-9fceb5ff832d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:13.857602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-4e13db21-d0c7-4f38-8ba7-0b2bc3319198 req-f7a1ea11-82b2-4485-a6ad-9fceb5ff832d service nova] Creating event network-changed:e260da27-bebb-41f0-843b-c81f7ae57657 for instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 on hv-cinder-85919 Sep 24 15:05:13.863486 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-4e13db21-d0c7-4f38-8ba7-0b2bc3319198 req-f7a1ea11-82b2-4485-a6ad-9fceb5ff832d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036397 Sep 24 15:05:13.864405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 377/742] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:14.330117 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1b1f77de-4ac8-46ad-9a4e-0965228ef1b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: .version_select at 0x7f7c10975790>, body: {"keypair": {"name": "tempest-keypair-2050048519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOpuNDVzAG26QOySspuhCVXRdphCTPywLLv8vJk0w9eDX2AWJEioOK2RwGxafzdP4d4jeKph962sJ7LFfN4gwqn7AeX2/qK3KMvR61nZ4kHaDGT2fEOSeuAIMOZayPQ8g=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:14.348356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-1b1f77de-4ac8-46ad-9a4e-0965228ef1b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:05:14.352928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-1b1f77de-4ac8-46ad-9a4e-0965228ef1b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for user 9f74f51060554db18bc96199222e9261 and project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:05:14.379226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1b1f77de-4ac8-46ad-9a4e-0965228ef1b9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053681 Sep 24 15:05:14.387138 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 366/743] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:05:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:16.238984 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1989552602", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8a01210a-747c-4b32-8123-27378a645fb5"}], "security_groups": [{"name": "tempest-securitygroup--733817205"}], "key_name": "tempest-keypair-2050048519", "user_data": "}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:16.350128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] validate_networks() for [('8a01210a-747c-4b32-8123-27378a645fb5', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:05:16.885800 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:05:16.886265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:05:16.887045 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:05:16.887464 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:05:16.887883 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:05:16.897107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:16.897645 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:16.898302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:16.899060 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:16.899508 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:16.899939 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:16.916853 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:05:16.921089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Getting quotas for user 9f74f51060554db18bc96199222e9261 and project 9b2919ee12fe488ea94db84e9af057a2. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:05:16.933103 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:05:16.935014 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:05:16.982632 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d34187c1-f286-46a4-9be4-ba69f1c81688 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.749600 Sep 24 15:05:16.983505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 378/744] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:05:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:05:16.995708 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-84b53044-3a39-4045-9ecc-6d7418ec7ac9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:16.996334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-84b53044-3a39-4045-9ecc-6d7418ec7ac9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:17.000012 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:17.061229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-84b53044-3a39-4045-9ecc-6d7418ec7ac9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:17.070324 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-84b53044-3a39-4045-9ecc-6d7418ec7ac9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1242 microversion: 2.1 time: 0.079063 Sep 24 15:05:17.071295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 367/745] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:16 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:05:17.567916 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-899bafd2-ff2e-4e0c-acdb-6fc64142962d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:17.569077 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-899bafd2-ff2e-4e0c-acdb-6fc64142962d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:17.577115 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-899bafd2-ff2e-4e0c-acdb-6fc64142962d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:17.578405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-899bafd2-ff2e-4e0c-acdb-6fc64142962d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:17.578860 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-899bafd2-ff2e-4e0c-acdb-6fc64142962d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:17.579747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-899bafd2-ff2e-4e0c-acdb-6fc64142962d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:17.580210 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-899bafd2-ff2e-4e0c-acdb-6fc64142962d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:17.580641 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-899bafd2-ff2e-4e0c-acdb-6fc64142962d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:17.607408 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-899bafd2-ff2e-4e0c-acdb-6fc64142962d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/ips" status: 200 len: 152 microversion: 2.20 time: 0.251676 Sep 24 15:05:17.608334 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 379/746] 10.222.0.61 () {60 vars in 1289 bytes} [Sat Sep 24 15:05:17 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/ips => generated 152 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 15:05:18.093623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:18.094272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:18.101189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:18.101683 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:18.102140 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:18.102834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:18.103294 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:18.103719 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:18.167073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:18.175175 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fd2f02fa-0404-4eab-a314-c2080350fba9 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1294 microversion: 2.1 time: 0.085718 Sep 24 15:05:18.175742 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 368/747] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:18 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:19.199064 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:19.199788 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:19.208655 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:19.209155 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:19.209597 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:19.210679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:19.211140 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:19.211816 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:19.424577 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:19.432637 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-357bad5f-8b13-497c-9b9c-bb7238e0293a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1367 microversion: 2.1 time: 0.237691 Sep 24 15:05:19.433219 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 380/748] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:19 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:19.479565 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:19.480151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:19.487813 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:19.488320 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:19.488836 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:19.489782 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:19.490273 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:19.490968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:19.518168 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lazy-loading 'flavor' on Instance uuid a4f0888f-6da8-42cb-826c-506383e4bd08 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:05:19.732654 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-718c826f-0ac8-459e-97bf-45af51068f52 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/action" status: 202 len: 0 microversion: 2.20 time: 0.256818 Sep 24 15:05:19.733258 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 369/749] 10.222.0.61 () {62 vars in 1319 bytes} [Sat Sep 24 15:05:19 2022] POST /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 24 15:05:19.742385 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:19.743268 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:19.750214 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:19.750693 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:19.751190 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:19.752280 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:19.752954 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:19.753576 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:19.756798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:19.976841 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:19.984971 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:19.986532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:19.987696 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-08f1c2c4-c028-42a7-b162-1fe4ead28db0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.250200 Sep 24 15:05:19.988437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 381/750] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:19 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:20.337377 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-8e440ece-3ea9-4799-9381-2afd67e13293 req-0a77db72-586f-476a-ab07-9b8c7cfe9835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68dcfbd6-61c3-46e6-9bab-42fc5b2ede39", "tag": "78b562bf-66a7-4369-88a3-a0823798cc5f"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:20.356011 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8e440ece-3ea9-4799-9381-2afd67e13293 req-0a77db72-586f-476a-ab07-9b8c7cfe9835 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:20.356648 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8e440ece-3ea9-4799-9381-2afd67e13293 req-0a77db72-586f-476a-ab07-9b8c7cfe9835 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:20.357103 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-8e440ece-3ea9-4799-9381-2afd67e13293 req-0a77db72-586f-476a-ab07-9b8c7cfe9835 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:20.369549 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-8e440ece-3ea9-4799-9381-2afd67e13293 req-0a77db72-586f-476a-ab07-9b8c7cfe9835 service nova] Creating event network-changed:78b562bf-66a7-4369-88a3-a0823798cc5f for instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 on hv-cinder-85919 Sep 24 15:05:20.375140 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-8e440ece-3ea9-4799-9381-2afd67e13293 req-0a77db72-586f-476a-ab07-9b8c7cfe9835 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041115 Sep 24 15:05:20.376115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 370/751] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:20.462812 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:20.463429 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:20.470209 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:20.470708 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:20.471151 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:20.471872 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:20.472332 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:20.472779 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:20.667915 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:20.676102 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7f3fa330-c5c5-43ed-9ca4-6f0a3f7bb99d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1367 microversion: 2.1 time: 0.220013 Sep 24 15:05:20.676712 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 382/752] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:20 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:21.014317 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:21.015085 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:21.022226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:21.022670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:21.023228 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:21.023974 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:21.024439 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:21.024873 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:21.160487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:21.168592 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:21.170089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:21.171763 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cdaee9f3-6708-47ef-90e4-7a5576663ad0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.161777 Sep 24 15:05:21.172327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 371/753] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:21 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:21.700504 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:21.701132 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:21.704024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:21.708896 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:21.709584 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:21.710072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:21.710787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:21.711251 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:21.711680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:21.929360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:21.937489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8574ebe7-14de-41ec-958f-0b46722a2ec8 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1367 microversion: 2.1 time: 0.240995 Sep 24 15:05:21.950152 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 383/754] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:21 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:05:22.196971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:22.198368 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:22.205920 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:22.207050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:22.207502 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:22.208632 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:22.209135 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:22.209556 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:22.364869 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:22.373509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:22.375523 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:22.376875 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5687bde3-ac18-4f72-a7de-f198d992d47f tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.184086 Sep 24 15:05:22.377440 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 372/755] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:22 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:22.961357 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:22.961998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:22.968730 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:22.969226 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:22.969667 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:22.970405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:22.970863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:22.971294 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:23.102310 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:23.110810 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c7c38af9-d8d8-4331-832c-85df4e30f3b0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1367 microversion: 2.1 time: 0.153307 Sep 24 15:05:23.111430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 384/756] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:22 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:23.402368 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:23.403112 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:23.410604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:23.411174 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:23.411703 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:23.412499 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:23.413020 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:23.413524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:23.550897 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:23.558996 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:23.560436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:23.561780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-91ed754f-6bd4-40a4-9229-8fe003671583 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.163238 Sep 24 15:05:23.562396 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 373/757] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:23 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:24.133695 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:24.134339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:24.141287 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:24.141781 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:24.142251 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:24.142951 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:24.143414 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:24.143847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:24.276857 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:24.284533 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-04147280-a2cd-4193-bcca-8cc0c0536514 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1367 microversion: 2.1 time: 0.154659 Sep 24 15:05:24.285106 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 385/758] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:24 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:24.588262 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:24.589008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:24.596151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:24.596652 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:24.597100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:24.597805 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:24.598306 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:24.598865 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:24.731594 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:24.740254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:24.742016 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:24.743191 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2e3375a0-65c2-4abc-b9ef-26742b1ebd8c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.158890 Sep 24 15:05:24.743754 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 374/759] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:24 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:25.303687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-5f500f48-3d81-40b1-aa54-adb5c33e6108 req-1ee28216-4c0f-4801-b531-ea91645cde9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68dcfbd6-61c3-46e6-9bab-42fc5b2ede39", "name": "network-vif-plugged", "status": "completed", "tag": "78b562bf-66a7-4369-88a3-a0823798cc5f"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:25.308391 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:25.309227 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:25.315587 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-5f500f48-3d81-40b1-aa54-adb5c33e6108 req-1ee28216-4c0f-4801-b531-ea91645cde9c service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:25.316090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-5f500f48-3d81-40b1-aa54-adb5c33e6108 req-1ee28216-4c0f-4801-b531-ea91645cde9c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:25.316357 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:25.317051 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:25.317179 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-5f500f48-3d81-40b1-aa54-adb5c33e6108 req-1ee28216-4c0f-4801-b531-ea91645cde9c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:25.317763 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:25.318936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:25.320967 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:25.321606 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:25.326269 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:25.329363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-5f500f48-3d81-40b1-aa54-adb5c33e6108 req-1ee28216-4c0f-4801-b531-ea91645cde9c service nova] Creating event network-vif-plugged:78b562bf-66a7-4369-88a3-a0823798cc5f for instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 on hv-cinder-85919 Sep 24 15:05:25.334593 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-5f500f48-3d81-40b1-aa54-adb5c33e6108 req-1ee28216-4c0f-4801-b531-ea91645cde9c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034831 Sep 24 15:05:25.335206 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 386/760] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:25.466668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:25.474852 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-05965fee-33c0-4abd-a1c3-9f3d87530ad1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1367 microversion: 2.1 time: 0.170865 Sep 24 15:05:25.475477 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 375/761] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:25 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:05:25.769001 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:25.769697 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:25.775852 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:25.777247 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:25.777894 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:25.778668 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:25.779209 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:25.780047 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:25.921806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:25.930180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:25.931670 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:25.932907 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fd07c8b6-c337-4632-8f15-6b955f88702c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.168089 Sep 24 15:05:25.933727 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 387/762] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:25 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:26.500817 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:26.501435 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:26.507822 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:26.508308 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:26.508744 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:26.509433 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:26.509895 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:26.510346 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:26.635714 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:26.643223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f7adac86-a1ce-49b2-9de2-7787d487b2b2 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1367 microversion: 2.1 time: 0.146881 Sep 24 15:05:26.643784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 376/763] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:26 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:26.958800 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:26.959423 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:26.961792 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:26.962491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=6 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:26.969314 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:26.969808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:26.970283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:26.970980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:26.971445 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:26.971882 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:27.102933 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:27.113659 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:27.115165 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:27.116660 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a5de83a9-95d9-4478-a2ab-2a57ef01e82d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.162176 Sep 24 15:05:27.117231 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 388/764] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:26 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:27.664787 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:27.665418 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:27.668589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:27.673148 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:27.673655 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:27.674125 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:27.675075 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:27.675546 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:27.675983 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:27.814734 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:27.822540 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f9f53933-3b1b-4371-a382-3aec386e5e94 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1556 microversion: 2.1 time: 0.161763 Sep 24 15:05:27.823120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 377/765] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:27 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:27.845149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fca24514-dc20-4778-a3a5-f6b89ee0591d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:27.845590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fca24514-dc20-4778-a3a5-f6b89ee0591d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:27.851441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fca24514-dc20-4778-a3a5-f6b89ee0591d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:27.851935 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fca24514-dc20-4778-a3a5-f6b89ee0591d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:27.852385 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fca24514-dc20-4778-a3a5-f6b89ee0591d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:27.853083 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fca24514-dc20-4778-a3a5-f6b89ee0591d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:27.853542 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fca24514-dc20-4778-a3a5-f6b89ee0591d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:27.854056 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fca24514-dc20-4778-a3a5-f6b89ee0591d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:27.944405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fca24514-dc20-4778-a3a5-f6b89ee0591d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103729 Sep 24 15:05:27.945042 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 389/766] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Sep 24 15:05:27 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:28.141877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:28.142589 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:28.148490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:28.148961 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:28.149407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:28.150138 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:28.150655 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:28.151088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:28.283713 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:28.291966 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:28.293522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:28.294800 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8ce5282b-1b98-4273-9f4a-e46270e10cbb tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.157396 Sep 24 15:05:28.295445 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 378/767] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:28 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:29.320728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:29.321411 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:29.338257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:29.338950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:29.339683 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:29.341163 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:29.341635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:29.342096 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:29.489757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-8e4d7e3d-930c-4482-99f0-f1366e9b7f03 req-2131292e-d7a8-44cb-bf9a-99e3486d3266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68dcfbd6-61c3-46e6-9bab-42fc5b2ede39", "tag": "78b562bf-66a7-4369-88a3-a0823798cc5f"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:29.503590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-8e4d7e3d-930c-4482-99f0-f1366e9b7f03 req-2131292e-d7a8-44cb-bf9a-99e3486d3266 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:29.504235 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-8e4d7e3d-930c-4482-99f0-f1366e9b7f03 req-2131292e-d7a8-44cb-bf9a-99e3486d3266 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:29.505050 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-8e4d7e3d-930c-4482-99f0-f1366e9b7f03 req-2131292e-d7a8-44cb-bf9a-99e3486d3266 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:29.520390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-8e4d7e3d-930c-4482-99f0-f1366e9b7f03 req-2131292e-d7a8-44cb-bf9a-99e3486d3266 service nova] Creating event network-changed:78b562bf-66a7-4369-88a3-a0823798cc5f for instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 on hv-cinder-85919 Sep 24 15:05:29.526099 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-8e4d7e3d-930c-4482-99f0-f1366e9b7f03 req-2131292e-d7a8-44cb-bf9a-99e3486d3266 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277591 Sep 24 15:05:29.528149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 390/768] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:29.544801 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:29.553056 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:29.554543 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:29.555902 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bf6c7e5e-d652-426a-9d27-b1fe20109bfd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.239129 Sep 24 15:05:29.556898 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 379/769] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:29 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:29.678785 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0adb7f96-59ad-46d9-b3cd-72b40ff93532 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:29.682771 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0adb7f96-59ad-46d9-b3cd-72b40ff93532 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:29.693672 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0adb7f96-59ad-46d9-b3cd-72b40ff93532 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:29.694451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0adb7f96-59ad-46d9-b3cd-72b40ff93532 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:29.695024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0adb7f96-59ad-46d9-b3cd-72b40ff93532 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:29.696525 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0adb7f96-59ad-46d9-b3cd-72b40ff93532 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:29.696525 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0adb7f96-59ad-46d9-b3cd-72b40ff93532 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:29.696921 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0adb7f96-59ad-46d9-b3cd-72b40ff93532 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:29.788472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0adb7f96-59ad-46d9-b3cd-72b40ff93532 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "POST /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/action" status: 202 len: 0 microversion: 2.1 time: 0.116472 Sep 24 15:05:29.789711 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 391/770] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:05:29 2022] POST /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 15:05:29.797661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:29.798312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:29.810027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:29.810924 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:29.811379 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:29.812630 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:29.813097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:29.813539 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:30.007319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:30.018039 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ce638739-d94a-48f1-b57c-af790d85c21c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1750 microversion: 2.1 time: 0.224125 Sep 24 15:05:30.026082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 380/771] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:29 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1750 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:30.581188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:30.585747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:30.589128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:30.589810 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:30.590274 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:30.591196 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:30.592159 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:30.592159 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:30.844408 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:30.852557 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:30.854493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:30.855798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-14da4312-abf9-40fe-b023-b0441bc5e2c0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1745 microversion: 2.20 time: 0.279071 Sep 24 15:05:30.856573 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 392/772] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:30 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1745 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:31.043286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:31.044053 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:31.050962 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:31.051492 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:31.051938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:31.052667 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:31.053307 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:31.053751 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:31.212685 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:31.221999 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ff6563ec-0d5c-4d03-a714-93f4882f8684 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1750 microversion: 2.1 time: 0.182741 Sep 24 15:05:31.230067 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 381/773] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:31 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:31.883229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:31.884620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:31.891382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:31.891883 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:31.892405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:31.893150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:31.893617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:31.894196 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:32.037619 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:32.045571 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:32.047776 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:32.049019 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ad596773-c145-457e-bc2d-d350442a3e7b tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1745 microversion: 2.20 time: 0.169864 Sep 24 15:05:32.049668 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 393/774] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:31 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:32.245373 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:32.246027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:32.252929 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:32.253447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:32.254975 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:32.255706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:32.256173 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:32.257078 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:32.405197 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:32.413817 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f21bffe6-58a8-4b1f-9dcf-fe65163dadd4 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1755 microversion: 2.1 time: 0.172334 Sep 24 15:05:32.414483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 382/775] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:32 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:33.074040 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:33.074684 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:33.081386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:33.081990 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:33.082644 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:33.084231 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:33.084770 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:33.085267 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:33.296952 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:33.307129 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:33.308560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:33.309986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bdb6d3e1-43f0-46fe-a385-7d032affe45c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1740 microversion: 2.20 time: 0.239898 Sep 24 15:05:33.310527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 394/776] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:33 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:33.437696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:33.438350 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:33.445056 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:33.445862 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:33.446646 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:33.447526 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:33.448303 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:33.448986 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:33.661986 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:33.672004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c83dcc45-7e76-48c7-8766-5824d7e175dd tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1755 microversion: 2.1 time: 0.238242 Sep 24 15:05:33.673047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 383/777] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:33 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:34.335575 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:34.336234 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:34.343824 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:34.344576 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:34.345177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:34.346070 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:34.346686 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:34.347274 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:34.503012 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:34.520320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:34.522522 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:34.523806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f69f70a0-fcc4-4a7e-b54a-bc1e21b74a12 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1740 microversion: 2.20 time: 0.192133 Sep 24 15:05:34.524762 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 395/778] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:34 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:34.696634 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:34.698129 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:34.705781 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:34.706422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:34.707193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:34.708688 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:34.710635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:34.711318 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:34.950478 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:34.965520 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-93a4771d-7ae0-4a06-849a-7ebdc357c362 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1755 microversion: 2.1 time: 0.272714 Sep 24 15:05:34.967322 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 384/779] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:34 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1755 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:35.522666 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-8cc1889e-2f85-426a-9937-5e3e2ac7a3b9 req-62ec8442-7820-4e2e-9036-2fd9bd7aad0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f0888f-6da8-42cb-826c-506383e4bd08", "name": "network-vif-plugged", "status": "completed", "tag": "63e76081-8d75-427d-84e4-cb30841ec95f"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:35.532526 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-8cc1889e-2f85-426a-9937-5e3e2ac7a3b9 req-62ec8442-7820-4e2e-9036-2fd9bd7aad0d service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:35.533304 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-8cc1889e-2f85-426a-9937-5e3e2ac7a3b9 req-62ec8442-7820-4e2e-9036-2fd9bd7aad0d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:35.534063 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-8cc1889e-2f85-426a-9937-5e3e2ac7a3b9 req-62ec8442-7820-4e2e-9036-2fd9bd7aad0d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:35.548964 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-8cc1889e-2f85-426a-9937-5e3e2ac7a3b9 req-62ec8442-7820-4e2e-9036-2fd9bd7aad0d service nova] Creating event network-vif-plugged:63e76081-8d75-427d-84e4-cb30841ec95f for instance a4f0888f-6da8-42cb-826c-506383e4bd08 on hv-cinder-85919 Sep 24 15:05:35.554909 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:35.555612 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:35.566524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:35.567271 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:35.569068 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-8cc1889e-2f85-426a-9937-5e3e2ac7a3b9 req-62ec8442-7820-4e2e-9036-2fd9bd7aad0d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201333 Sep 24 15:05:35.570267 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:35.571029 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:35.571659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:35.571915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:35.576111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 396/780] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:05:35.720332 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:35.730117 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:35.731938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:35.733119 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ce1fe765-d264-4a71-bc25-2b6a6739eec4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1740 microversion: 2.20 time: 0.182441 Sep 24 15:05:35.746797 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 385/781] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:35 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:35.993965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:35.994638 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:36.001181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:36.001684 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:36.002166 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:36.002875 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:36.003338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:36.003767 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:36.190144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:36.190144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-893c22fa-0710-49d7-97d7-9039d146c547 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1755 microversion: 2.1 time: 0.199934 Sep 24 15:05:36.190144 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 397/782] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:35 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:36.765048 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:36.766388 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:36.773401 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:36.773894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:36.774410 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:36.775116 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:36.775583 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:36.776042 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:36.943927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:36.952909 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:36.954694 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:36.957355 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-40529d56-79e5-4e43-9268-0c361993933c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1740 microversion: 2.20 time: 0.198276 Sep 24 15:05:36.958241 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 386/783] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:36 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:37.215240 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:37.215805 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:37.222903 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:37.223658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:37.224108 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:37.224825 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:37.225297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:37.225732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:37.403169 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:37.411679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-362f80b3-1039-4923-85cc-44380f690875 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1755 microversion: 2.1 time: 0.200341 Sep 24 15:05:37.412497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 398/784] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:37 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:37.984721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:37.985748 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:37.994182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:37.995502 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:37.996414 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:37.997824 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:37.998537 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:37.999260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:38.151670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:38.159735 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:38.161519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:38.163043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a921a876-35c2-45e3-a346-629da8e2868e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1740 microversion: 2.20 time: 0.182726 Sep 24 15:05:38.163766 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 387/785] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:37 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:38.435957 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:38.437783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:38.445671 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:38.446610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:38.447253 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:38.448177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:38.448802 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:38.449400 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:38.452490 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:38.609371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:38.618392 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-09a6360f-53e8-495c-addf-f6f5955f67ab tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1755 microversion: 2.1 time: 0.186412 Sep 24 15:05:38.619310 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 399/786] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:38 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:39.188482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:39.189100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:39.197195 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:39.198035 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:39.199270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:39.200251 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:39.200923 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:39.201688 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:39.369528 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:39.380047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:39.381863 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:39.383362 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ac021951-3a93-419e-a6c6-443f72ca550d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1740 microversion: 2.20 time: 0.198904 Sep 24 15:05:39.384671 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 388/787] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:39 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:39.643423 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:39.644728 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:39.651866 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:39.652577 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:39.653174 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:39.654090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:39.654707 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:39.655342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:39.855256 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:39.867332 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-16ab4b11-3777-4434-a012-01176524e863 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1755 microversion: 2.1 time: 0.227909 Sep 24 15:05:39.868018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 400/788] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:39 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1755 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:40.412687 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:40.413292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:40.423773 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:40.424757 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:40.425353 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:40.426248 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:40.426920 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:40.427962 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:40.589440 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:40.598926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:40.600417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:40.601715 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-da47c2ac-401f-4383-99e2-cc4ebc7d16b0 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1740 microversion: 2.20 time: 0.192806 Sep 24 15:05:40.602306 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 389/789] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:40 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:40.895140 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:40.896829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:40.904451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:40.906248 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:40.906908 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:40.907906 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:40.908683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:40.909284 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:41.103919 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:41.112354 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f128b569-c66f-430e-982a-0f788e305b23 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1755 microversion: 2.1 time: 0.224658 Sep 24 15:05:41.126646 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 401/790] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:40 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1755 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:41.628957 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:41.630248 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:41.637683 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:41.638476 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:41.639234 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:41.640855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:41.641850 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:41.643456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:41.801351 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:41.813887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:41.815777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:41.817022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-eb484cd3-6a13-4e2e-99c0-ef266d4483fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1740 microversion: 2.20 time: 0.192435 Sep 24 15:05:41.817605 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 390/791] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:41 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:42.137294 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:42.137835 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:42.144993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:42.145497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:42.146116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:42.146999 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:42.147626 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:42.148228 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:42.306130 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:42.316631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ecaaea76-5603-496e-a026-ef6ac0c24b47 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1755 microversion: 2.1 time: 0.183370 Sep 24 15:05:42.317204 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 402/792] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:42 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:42.802517 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:42.803095 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:42.809425 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:42.809936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:42.810446 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:42.811156 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:42.811615 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:42.812050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:42.835882 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lazy-loading 'flavor' on Instance uuid 775dbe6e-e603-4a12-84b4-3bae6637954d {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:05:42.839289 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:42.846530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:42.847236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:42.853162 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:42.853731 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:42.854292 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:42.855061 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:42.855638 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:42.856166 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:42.914100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-650b08ab-cf79-4c90-9fc3-6b3011824d6f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "POST /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d/action" status: 202 len: 0 microversion: 2.1 time: 0.115249 Sep 24 15:05:42.914703 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 391/793] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:05:42 2022] POST /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:05:42.924786 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:42.925432 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:42.932754 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:42.933845 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:42.934748 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:42.935399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:42.935979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:42.936430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:43.002993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:43.011127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:43.012580 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:43.014944 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-17a83110-3b6f-474b-94ae-065a164d516e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1740 microversion: 2.20 time: 0.172221 Sep 24 15:05:43.015522 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 403/794] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:42 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:05:43.073698 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:43.082203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5cb7a344-42fd-4231-a44f-1e2dd3fe1cec tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.162977 Sep 24 15:05:43.082774 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 392/795] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:42 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:43.344559 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:43.345180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:43.351527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:43.352022 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:43.352467 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:43.353171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:43.353635 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:43.354111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:43.498309 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:43.507685 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ed11ec52-4bda-453a-a76c-f56d023a1853 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1758 microversion: 2.1 time: 0.167004 Sep 24 15:05:43.508340 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 404/796] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:43 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:44.040270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:44.040871 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:44.047378 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:44.047870 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:44.048342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:44.049048 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:44.049509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:44.049968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:44.107812 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:44.108426 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:44.114649 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:44.115149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:44.115596 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:44.116563 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:44.117026 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:44.117459 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:44.187039 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:44.195427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:44.197007 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:44.198198 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b744aebe-b82a-4d10-b920-f89b09d82b07 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1722 microversion: 2.20 time: 0.161812 Sep 24 15:05:44.199213 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 393/797] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:44 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:44.261745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:44.270450 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3fbcd926-d3cd-4e27-a8a4-9b1f556f41e0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.166548 Sep 24 15:05:44.270988 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 405/798] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:44 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:05:45.224994 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:45.225613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:45.232090 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:45.232586 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:45.233076 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:45.233777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:45.234277 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:45.234716 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:45.294491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:45.295113 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:45.301423 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:45.301931 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:45.302395 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:45.303114 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:45.303573 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:45.304209 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:45.376729 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:45.384972 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:45.386495 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:45.387668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-87f043aa-8a9d-4132-b638-a0ace9616869 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1722 microversion: 2.20 time: 0.166750 Sep 24 15:05:45.400788 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 394/799] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:45 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:45.442989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:45.451683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0051d202-d33c-4339-8141-f69e096630b3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.161215 Sep 24 15:05:45.452870 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 406/800] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:45 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:05:46.413859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:46.414486 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:46.421742 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:46.422271 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:46.422714 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:46.423406 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:46.423870 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:46.424315 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:46.476193 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:46.476833 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:46.483799 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:46.484287 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:46.484735 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:46.485443 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:46.486126 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:46.486562 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:46.566666 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:46.576501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:46.578291 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:46.579829 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5e7f83a8-e304-4f5f-b085-3cf393a1e2fc tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1725 microversion: 2.20 time: 0.169922 Sep 24 15:05:46.580877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 395/801] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:46 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:46.618080 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-802063c2-ff44-4460-887a-5bff4c373793 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f95238a-d9fa-4e2c-9e18-448231dfc636"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:46.621753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-802063c2-ff44-4460-887a-5bff4c373793 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:46.630274 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-802063c2-ff44-4460-887a-5bff4c373793 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:46.631106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-802063c2-ff44-4460-887a-5bff4c373793 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:46.632231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-802063c2-ff44-4460-887a-5bff4c373793 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:46.633538 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-802063c2-ff44-4460-887a-5bff4c373793 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:46.634189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-802063c2-ff44-4460-887a-5bff4c373793 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:46.634774 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-802063c2-ff44-4460-887a-5bff4c373793 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:46.648348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:46.665479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-cf675239-5f34-41e7-b009-2241cc227e83 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.193061 Sep 24 15:05:46.666857 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 407/802] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:46 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:46.939634 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-802063c2-ff44-4460-887a-5bff4c373793 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327157 Sep 24 15:05:46.940474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 396/803] 10.222.0.61 () {62 vars in 1364 bytes} [Sat Sep 24 15:05:46 2022] POST /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 15:05:47.088067 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3372712b-8ad3-4c90-b275-d54eb91bf427 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:47.088567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3372712b-8ad3-4c90-b275-d54eb91bf427 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:47.094460 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3372712b-8ad3-4c90-b275-d54eb91bf427 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:47.094953 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3372712b-8ad3-4c90-b275-d54eb91bf427 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:47.095389 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3372712b-8ad3-4c90-b275-d54eb91bf427 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:47.096088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3372712b-8ad3-4c90-b275-d54eb91bf427 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:47.096639 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3372712b-8ad3-4c90-b275-d54eb91bf427 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:47.097072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3372712b-8ad3-4c90-b275-d54eb91bf427 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:47.455089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-387149c7-398c-4b4c-b8ba-d76ea8204419 req-91923772-d89c-4dfd-b0de-c312a6fad6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f0888f-6da8-42cb-826c-506383e4bd08", "name": "network-vif-unplugged", "status": "completed", "tag": "63e76081-8d75-427d-84e4-cb30841ec95f"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:47.463885 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=62 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:47.469473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-387149c7-398c-4b4c-b8ba-d76ea8204419 req-91923772-d89c-4dfd-b0de-c312a6fad6d1 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:47.470044 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-387149c7-398c-4b4c-b8ba-d76ea8204419 req-91923772-d89c-4dfd-b0de-c312a6fad6d1 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:47.470412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-387149c7-398c-4b4c-b8ba-d76ea8204419 req-91923772-d89c-4dfd-b0de-c312a6fad6d1 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:47.481488 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.compute.server_external_events [req-387149c7-398c-4b4c-b8ba-d76ea8204419 req-91923772-d89c-4dfd-b0de-c312a6fad6d1 service nova] Unable to find a host for instance a4f0888f-6da8-42cb-826c-506383e4bd08. Dropping event network-vif-unplugged {{(pid=120591) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 24 15:05:47.482420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-387149c7-398c-4b4c-b8ba-d76ea8204419 req-91923772-d89c-4dfd-b0de-c312a6fad6d1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032614 Sep 24 15:05:47.483020 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 397/804] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 24 15:05:47.514096 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3372712b-8ad3-4c90-b275-d54eb91bf427 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/os-volume_attachments/3f95238a-d9fa-4e2c-9e18-448231dfc636" status: 202 len: 0 microversion: 2.20 time: 0.429908 Sep 24 15:05:47.515579 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 408/805] 10.222.0.61 () {60 vars in 1457 bytes} [Sat Sep 24 15:05:47 2022] DELETE /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/os-volume_attachments/3f95238a-d9fa-4e2c-9e18-448231dfc636 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:05:47.578592 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:05:47.579249 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:47.585299 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:47.585794 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:47.586262 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:47.586964 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:47.587436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:47.587870 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:47.691916 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:47.692462 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:47.700743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:47.701275 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:47.701727 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:47.702687 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:47.703309 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:47.704316 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:47.771706 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120591) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 15:05:47.838076 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-126ed811-6877-45c9-85b0-47adce82c289 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "POST /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/action" status: 202 len: 0 microversion: 2.20 time: 0.264361 Sep 24 15:05:47.838796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 398/806] 10.222.0.61 () {62 vars in 1319 bytes} [Sat Sep 24 15:05:47 2022] POST /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 24 15:05:47.846072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:47.846705 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:47.847385 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:47.853675 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:47.854226 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a1a04d2f-46fb-499a-834d-1b224c322a96 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.166400 Sep 24 15:05:47.854385 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:47.854839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:47.855099 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 409/807] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:47 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:05:47.855672 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:47.856194 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:47.856693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:47.990281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:48.004781 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:48.006375 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:48.007573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-84fa753f-4889-4ec7-8acd-afe10f20032a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1673 microversion: 2.20 time: 0.164711 Sep 24 15:05:48.008136 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 399/808] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:47 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:05:48.879747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:48.880371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:48.886444 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:48.886942 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:48.887387 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:48.888121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:48.888590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:48.889030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:49.023125 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:49.031046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-45953357-c4c2-4b10-91c8-0cf544c7f182 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.155173 Sep 24 15:05:49.031620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 410/809] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:48 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:49.032599 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:49.033231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:49.039747 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:49.040240 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:49.040685 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:49.041388 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:49.041849 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:49.042307 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:49.167385 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:49.175857 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:49.177344 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:49.178541 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3f8cd793-7d4d-4e50-8442-b70840b58bbd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1673 microversion: 2.20 time: 0.149949 Sep 24 15:05:49.179103 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 400/810] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:49 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:05:50.054065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:50.054679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:50.061498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:50.062099 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:50.062541 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:50.063231 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:50.063689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:50.064115 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:50.197047 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:50.204536 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:50.205179 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:50.205396 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-30286faf-0574-4cc6-82b7-fc0912a7ef16 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.155178 Sep 24 15:05:50.205991 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 411/811] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:50 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:50.211480 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:50.211965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:50.212400 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:50.213094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:50.213549 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:50.214002 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:50.341535 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:50.350164 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:50.351654 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:50.352859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cfc1daba-49e9-43a3-8683-d0f44e1aa8ee tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1673 microversion: 2.20 time: 0.152744 Sep 24 15:05:50.353413 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 401/812] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:50 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:05:51.228433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:51.229080 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:51.236156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:51.236660 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:51.237104 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:51.237871 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:51.238281 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:51.238713 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:51.375234 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:51.380661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:51.381323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:51.384039 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-abec4369-cfe9-4c56-9ed0-3124703ec41b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.159269 Sep 24 15:05:51.398015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 412/813] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:51 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:51.402338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:51.402731 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:51.408394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:51.409249 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:51.409725 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:51.410215 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:51.553729 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:51.562548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:51.564235 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:51.565609 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0741e97b-d6b6-4c4a-95bc-9d9ae6a76c31 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.190575 Sep 24 15:05:51.566203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 402/814] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:51 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:52.411479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:52.412134 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:52.414435 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=60 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:52.420044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:52.421101 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:52.421547 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:52.422271 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:52.422740 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:52.423179 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:52.427353 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:52.556170 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:52.563694 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-37cc7541-dc5a-4358-8514-e319a165f413 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.156080 Sep 24 15:05:52.564260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 413/815] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:52 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:05:52.591750 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:52.592899 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:52.599203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:52.599689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:52.600125 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:52.600812 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:52.601268 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:52.601693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:52.617321 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:05:52.733831 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:52.742145 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:52.743938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:52.745104 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e79833fd-6e31-4efd-9979-0e8ac5b90c73 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.157188 Sep 24 15:05:52.745752 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 403/816] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:52 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:05:53.586343 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:53.586962 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:53.594194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:53.594716 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:53.595149 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:53.595852 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:53.596320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:53.596754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:53.731125 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:53.738869 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-908af34b-a9b3-4518-a301-78bdf57e9979 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.156431 Sep 24 15:05:53.739452 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 414/817] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:53 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:53.770994 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:53.771609 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:53.777997 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:53.778491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:53.778938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:53.779633 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:53.780179 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:53.780528 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:53.909391 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:53.917453 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:53.918945 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:53.920117 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9a7bcd59-11f9-4c8c-80f9-7c4275cbd06e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.153092 Sep 24 15:05:53.920674 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 404/818] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:53 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:05:54.763925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:54.764555 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:54.771005 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:54.771502 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:54.771940 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:54.772631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:54.773086 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:54.773515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:54.945944 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:54.946556 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:54.953588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:54.954133 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:54.954577 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:54.955311 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:54.955786 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:54.956207 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:54.990668 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:55.007145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-828558b8-cb53-47bf-a3fa-b5dfb2197052 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.246966 Sep 24 15:05:55.007774 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 415/819] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:54 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:55.088561 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:55.097725 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:55.099180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:55.100375 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6225b97d-8454-40cb-83bd-4dcd6d5f15b7 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.158442 Sep 24 15:05:55.100942 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 405/820] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:54 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:05:56.031173 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:56.031830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:56.038131 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:56.038603 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:56.039044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:56.039737 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:56.040218 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:56.040646 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:56.126350 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:56.126963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:56.133685 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:56.134217 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:56.134657 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:56.135363 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:56.135824 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:56.136358 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:56.180412 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:56.188964 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-48112adf-74c2-48d3-827a-8299c1e4ea3b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.161972 Sep 24 15:05:56.205238 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 416/821] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:56 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:56.289809 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:56.298852 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:56.300319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:56.301509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e09382c6-0d4a-49d6-b163-ce8a1d4bbb1e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.179646 Sep 24 15:05:56.302110 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 406/822] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:56 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:05:57.212873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:57.213442 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:57.220778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:57.221279 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:57.221727 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:57.222472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:57.222932 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:57.223367 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:57.329182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:57.329801 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:57.336588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:57.337088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:57.337533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:57.338282 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:57.338753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:57.339222 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:57.363605 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:57.375201 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b5f0c307-3046-4437-81ad-d81d1dc61e89 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.166384 Sep 24 15:05:57.375791 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 417/823] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:57 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:57.485667 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:57.494046 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:57.495518 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:57.496701 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-238b5a4e-bdc0-4697-91ac-905b040bb83c tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.171988 Sep 24 15:05:57.497267 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 407/824] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:57 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:05:58.399261 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:58.400526 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:58.407971 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:58.408483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:58.408929 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:58.409647 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:58.410147 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:58.410588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:58.523371 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:58.524204 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:58.531930 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:58.532469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:58.533178 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:58.534163 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:58.534630 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:58.535269 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:58.552588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:58.564101 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-97e9b2c2-5c50-47b2-a59f-9f16d57566a8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.168577 Sep 24 15:05:58.564694 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 418/825] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:58 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:58.674803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:58.683397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:58.684859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:58.686081 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1ba17fcf-f12f-442f-8e6d-54b7ffd5864d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.167078 Sep 24 15:05:58.686825 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 408/826] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:58 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:05:59.587695 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:59.588483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:59.595026 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:59.595520 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:59.595961 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:59.596665 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:59.597128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:59.597557 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:59.712094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:05:59.713536 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:05:59.719500 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:59.720337 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:59.721008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:59.721964 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:05:59.722642 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:05:59.723563 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:05:59.734783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:59.743498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0aba6c4a-c677-4442-a2a7-b3919acea92a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.159546 Sep 24 15:05:59.750714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 419/827] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:05:59 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:05:59.876609 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:59.885611 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:59.887082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:05:59.888250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e3e368f6-66ab-4f1f-9201-031a9d0bfa27 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.180246 Sep 24 15:05:59.888981 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 409/828] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:05:59 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:00.774683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:00.775475 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:00.784238 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:00.784844 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:00.785397 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:00.786334 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:00.787798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:00.787798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:00.914206 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:00.914847 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:00.924067 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:00.924968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:00.925558 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:00.926314 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:00.927145 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:00.927869 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:00.979518 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:00.992208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-67628879-b1be-480b-b925-bdadf7732e92 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.227935 Sep 24 15:06:00.993403 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 420/829] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:00 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:01.085781 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:01.095149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:01.096613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:01.097789 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7a834c30-a897-450b-9662-81871a40059d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.187550 Sep 24 15:06:01.098391 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 410/830] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:00 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:06:02.023445 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:02.024173 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:02.033804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:02.034338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:02.034785 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:02.035505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:02.035974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:02.036415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:02.126824 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:02.127752 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:02.137027 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:02.137468 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:02.138022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:02.138844 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:02.139319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:02.139761 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:02.186227 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:02.195314 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-18d05bbb-9900-4863-84fe-d9e0dc177d05 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.175727 Sep 24 15:06:02.196120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 421/831] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:02 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:02.295637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:02.304827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:02.306305 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:02.307482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f3402d34-e534-409d-bb5e-d4c36dd756ca tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.186255 Sep 24 15:06:02.308044 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 411/832] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:02 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:03.218903 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:03.219814 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:03.236758 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:03.237265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:03.237706 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:03.238511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:03.239012 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:03.239578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:03.333698 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:03.334527 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:03.341115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:03.341983 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:03.342660 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:03.343647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:03.344327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:03.344975 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:03.387166 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:03.401078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d6cac9f3-4b74-4d06-bc1a-8aabd3433b7d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.186444 Sep 24 15:06:03.402017 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 422/833] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:03 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:03.495393 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:03.504662 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:03.506154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:03.507387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6e083eff-2592-4ad5-8dc3-9073468d95a4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.178746 Sep 24 15:06:03.507945 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 412/834] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:03 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:04.424975 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:04.425691 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:04.432735 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:04.433260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:04.433933 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:04.435085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:04.435564 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:04.436005 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:04.532439 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:04.533132 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:04.540274 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:04.541120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:04.541792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:04.542749 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:04.543424 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:04.554272 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:04.585098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:04.594034 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8b8ccdcd-71d4-48b0-a1a2-6efade6312aa tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.173106 Sep 24 15:06:04.595740 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 423/835] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:04 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:04.710642 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:04.720079 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:04.721583 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:04.722882 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-173a45e9-3094-441a-9756-4bc6739d7726 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.194369 Sep 24 15:06:04.723448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 413/836] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:04 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:06:05.620201 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:05.620823 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:05.627511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:05.628009 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:05.628450 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:05.629158 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:05.629621 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:05.630083 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:05.749010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:05.751151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:05.758920 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:05.759606 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:05.760190 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:05.761155 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:05.761724 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:05.762397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:05.885196 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:05.904132 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a890732b-0bc3-40cf-a57d-9b3fc2d610f8 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.287996 Sep 24 15:06:05.904739 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 424/837] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:05 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:05.975452 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:05.985407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:05.989421 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:05.996709 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1f7739e7-ebe1-4bc9-a1b7-a71c50dae4f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.248170 Sep 24 15:06:05.999265 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 414/838] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:05 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:06:06.928121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:06.928770 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:06.935354 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:06.935854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:06.936298 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:06.936998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:06.937495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:06.937943 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:07.026152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:07.026867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:07.034031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:07.034950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:07.035434 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:07.036135 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:07.036601 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:07.037057 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:07.073726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:07.085455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-578b2a9d-e3b9-42c4-bad1-6ab4dd1a4f8b tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.161130 Sep 24 15:06:07.086188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 425/839] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:06 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:07.170394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:07.178409 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:07.179849 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:07.181009 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-afd68b55-1cc3-49a6-a5e4-afe5193313ae tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.158725 Sep 24 15:06:07.181566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 415/840] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:07 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:06:08.110436 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:08.111056 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:08.117924 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:08.118437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:08.118876 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:08.119614 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:08.120101 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:08.120531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:08.206148 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:08.206898 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:08.213143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:08.213639 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:08.214131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:08.214831 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:08.215288 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:08.215721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:08.273722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:08.282243 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6217e055-c152-46b7-9798-970412ba9a35 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.176193 Sep 24 15:06:08.282827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 426/841] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:08 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:08.353086 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:08.361834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:08.363319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:08.364487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-95c226f0-09fd-4f49-add9-fe8426098435 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.162370 Sep 24 15:06:08.365049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 416/842] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:08 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:06:09.306405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:09.307246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:09.314302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:09.314791 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:09.315230 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:09.315920 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:09.316380 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:09.316830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:09.390462 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:09.391097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:09.398757 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:09.399250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:09.399691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:09.400393 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:09.400852 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:09.401276 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:09.460626 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:09.471052 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-11e09d27-aef3-4f0d-893b-3c945dfa13c6 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.169225 Sep 24 15:06:09.471858 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 427/843] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:09 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:09.536604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:09.544811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:09.547138 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:09.548531 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ea2be276-a5a1-40b4-9df1-cf9e88574aa5 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.162018 Sep 24 15:06:09.549098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 417/844] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:09 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:10.496039 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:10.496669 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:10.503722 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:10.504218 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:10.504657 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:10.505358 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:10.505817 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:10.506382 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:10.573769 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:10.574516 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:10.581003 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:10.581541 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:10.582050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:10.582838 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:10.583316 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:10.583753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:10.652441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:10.661028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-92bce893-2080-4ab8-8edc-fcdbc433e886 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.169840 Sep 24 15:06:10.661613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 428/845] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:10 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:10.728808 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:10.736995 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:10.738508 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:10.739686 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9902290b-2988-4599-8a1a-8be533525823 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.169857 Sep 24 15:06:10.740249 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 418/846] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:10 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:06:11.568265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-a3205d05-78ae-49ac-a840-a178fbf8d774 req-d40ac4ad-c1ab-4c0c-abef-9b1fd3b4c455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f0888f-6da8-42cb-826c-506383e4bd08", "name": "network-vif-plugged", "status": "completed", "tag": "63e76081-8d75-427d-84e4-cb30841ec95f"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:11.579260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a3205d05-78ae-49ac-a840-a178fbf8d774 req-d40ac4ad-c1ab-4c0c-abef-9b1fd3b4c455 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:11.579749 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a3205d05-78ae-49ac-a840-a178fbf8d774 req-d40ac4ad-c1ab-4c0c-abef-9b1fd3b4c455 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:11.580186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a3205d05-78ae-49ac-a840-a178fbf8d774 req-d40ac4ad-c1ab-4c0c-abef-9b1fd3b4c455 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:11.591363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-a3205d05-78ae-49ac-a840-a178fbf8d774 req-d40ac4ad-c1ab-4c0c-abef-9b1fd3b4c455 service nova] Creating event network-vif-plugged:63e76081-8d75-427d-84e4-cb30841ec95f for instance a4f0888f-6da8-42cb-826c-506383e4bd08 on hv-cinder-85919 Sep 24 15:06:11.596476 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-a3205d05-78ae-49ac-a840-a178fbf8d774 req-d40ac4ad-c1ab-4c0c-abef-9b1fd3b4c455 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Sep 24 15:06:11.597272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 429/847] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:06:11.685244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:11.686553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:11.694576 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:11.695330 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:11.695974 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:11.696895 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:11.697958 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:11.698553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:11.767476 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:11.768322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:11.775170 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:11.775925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:11.776373 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:11.777090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:11.777959 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:11.778901 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:11.799847 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=100 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:11.840892 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:11.849345 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e3afdeb9-fc72-4f6a-826b-3630345fe21f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1510 microversion: 2.1 time: 0.168537 Sep 24 15:06:11.850201 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 419/848] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:11 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:11.871916 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:11.872510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:11.878869 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:11.879365 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:11.879802 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:11.880496 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:11.880957 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:11.881386 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:11.885065 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=100 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:11.910183 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120591) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 15:06:11.918845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:11.928167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:11.929950 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:11.931164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7358f184-bf49-4d43-810c-4c027e5fe6a9 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.168710 Sep 24 15:06:11.931740 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 430/849] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:11 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:06:11.994078 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bc3e4d19-eb48-43e9-8f19-7055d01724a4 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "POST /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d/action" status: 202 len: 0 microversion: 2.1 time: 0.125693 Sep 24 15:06:11.994507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 420/850] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:06:11 2022] POST /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 15:06:12.004536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:12.005673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:12.011693 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:12.012194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:12.012643 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:12.013748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:12.014854 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:12.015535 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:12.213936 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:12.222437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f5d0f390-3f17-46da-b1a3-af27b42f4105 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1518 microversion: 2.1 time: 0.223490 Sep 24 15:06:12.223008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 431/851] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:11 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1518 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:12.957303 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:12.958022 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:12.963994 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:12.964513 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:12.964954 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:12.965655 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:12.966147 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:12.966582 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:13.094289 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:13.102767 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:13.104340 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:13.105506 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-982b800c-8071-46a5-b872-a66d6364a121 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.152658 Sep 24 15:06:13.106415 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 421/852] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:12 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:13.246263 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:13.246878 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:13.253727 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:13.254247 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:13.254688 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:13.255376 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:13.255830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:13.256257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:13.385800 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:13.393790 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-1ffc0329-4d4b-4ccd-8897-727498e00b98 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1520 microversion: 2.1 time: 0.151451 Sep 24 15:06:13.394544 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 432/853] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:13 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:13.627927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-5c247443-45b7-40a4-a0c2-5c158cb252c1 req-b0777b84-aba1-49d2-b6f6-4881d21de547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775dbe6e-e603-4a12-84b4-3bae6637954d", "name": "network-vif-unplugged", "status": "completed", "tag": "10e26e89-d2cf-44a3-8d75-3fdc714831ff"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:13.637301 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-5c247443-45b7-40a4-a0c2-5c158cb252c1 req-b0777b84-aba1-49d2-b6f6-4881d21de547 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:13.637789 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-5c247443-45b7-40a4-a0c2-5c158cb252c1 req-b0777b84-aba1-49d2-b6f6-4881d21de547 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:13.638329 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-5c247443-45b7-40a4-a0c2-5c158cb252c1 req-b0777b84-aba1-49d2-b6f6-4881d21de547 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:13.649647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.compute.server_external_events [req-5c247443-45b7-40a4-a0c2-5c158cb252c1 req-b0777b84-aba1-49d2-b6f6-4881d21de547 service nova] Unable to find a host for instance 775dbe6e-e603-4a12-84b4-3bae6637954d. Dropping event network-vif-unplugged {{(pid=120591) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 24 15:06:13.650574 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-5c247443-45b7-40a4-a0c2-5c158cb252c1 req-b0777b84-aba1-49d2-b6f6-4881d21de547 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026612 Sep 24 15:06:13.651156 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 422/854] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 24 15:06:14.132204 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:14.132903 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:14.138915 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:14.139497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:14.140777 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:14.141550 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:14.142328 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:14.142795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:14.293179 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:14.302224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:14.304027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:14.305516 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6afeec6a-c369-41c4-8a5e-52009c6df570 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1731 microversion: 2.20 time: 0.177733 Sep 24 15:06:14.306374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 433/855] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:14 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:14.418161 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:14.419362 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:14.426323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:14.426824 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:14.427443 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:14.428352 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:14.428904 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:14.429342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:14.561801 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:14.569532 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6accb960-741b-4881-8b43-f3cff3ffd818 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.155391 Sep 24 15:06:14.570121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 423/856] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:14 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:15.331175 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:15.332421 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:15.338802 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:15.339323 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:15.339764 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:15.340537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:15.341060 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:15.341491 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:15.480189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:15.488748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:15.490466 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:15.491908 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f13a15eb-31b8-4583-ae9c-54358540973a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1718 microversion: 2.20 time: 0.164798 Sep 24 15:06:15.492479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 434/857] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:15 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 15:06:15.593928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:15.594539 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:15.600592 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:15.601089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:15.601534 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:15.602264 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:15.602731 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:15.603162 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:15.732343 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:15.740622 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-10f2751b-61b4-4f4d-8ec7-3cf4a09d726a tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.151123 Sep 24 15:06:15.741483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 424/858] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:15 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:16.446947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b231c7ee-3618-4d5c-9f42-e7c105dd5967 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:16.447503 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b231c7ee-3618-4d5c-9f42-e7c105dd5967 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:16.454522 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b231c7ee-3618-4d5c-9f42-e7c105dd5967 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:16.455002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b231c7ee-3618-4d5c-9f42-e7c105dd5967 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:16.455448 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b231c7ee-3618-4d5c-9f42-e7c105dd5967 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:16.456143 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b231c7ee-3618-4d5c-9f42-e7c105dd5967 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:16.456605 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b231c7ee-3618-4d5c-9f42-e7c105dd5967 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:16.457037 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b231c7ee-3618-4d5c-9f42-e7c105dd5967 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:16.479597 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b231c7ee-3618-4d5c-9f42-e7c105dd5967 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/ips" status: 200 len: 149 microversion: 2.1 time: 0.036502 Sep 24 15:06:16.480183 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 435/859] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 15:06:16 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:16.764507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:16.765250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:16.772164 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:16.772681 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:16.773133 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:16.773848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:16.774343 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:16.774801 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:16.904628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:16.912479 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2c44883e-3c9d-4b09-a0df-62b2e6e03b40 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.152172 Sep 24 15:06:16.913053 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 425/860] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:16 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:17.805291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-022e25b0-bbba-4523-aace-6e613a2bf2b5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc47a417-418a-49d8-9f8a-661ef6578123"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:17.807914 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-022e25b0-bbba-4523-aace-6e613a2bf2b5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:17.814662 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-022e25b0-bbba-4523-aace-6e613a2bf2b5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:17.815153 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-022e25b0-bbba-4523-aace-6e613a2bf2b5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:17.815602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-022e25b0-bbba-4523-aace-6e613a2bf2b5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:17.816297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-022e25b0-bbba-4523-aace-6e613a2bf2b5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:17.816761 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-022e25b0-bbba-4523-aace-6e613a2bf2b5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:17.817194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-022e25b0-bbba-4523-aace-6e613a2bf2b5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:17.936743 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:17.937369 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:17.939778 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:17.945169 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:17.945668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:17.946145 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:17.946854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:17.947320 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:17.947758 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:18.085625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:18.095049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a27e7f1c-17ac-413c-a267-af9736f157b1 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.162277 Sep 24 15:06:18.095946 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 426/861] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:17 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:06:18.111411 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-022e25b0-bbba-4523-aace-6e613a2bf2b5 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "POST /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309752 Sep 24 15:06:18.112042 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 436/862] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:06:17 2022] POST /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:19.119534 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:19.120036 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:19.126986 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:19.127477 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:19.127915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:19.128609 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:19.129069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:19.129499 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:19.258177 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:19.265887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-24a7948a-cdea-4e88-bcdc-9a4722fbfb08 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.150622 Sep 24 15:06:19.266475 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 427/863] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:19 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:20.290083 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:20.290793 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:20.297505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:20.298038 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:20.298740 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:20.299181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:20.299643 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:20.300076 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:20.434187 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:20.442927 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9c51d29a-57c4-4aae-be6f-05a856d93687 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.157763 Sep 24 15:06:20.443519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 437/864] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:20 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:21.466863 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:21.467483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:21.474164 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:21.474661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:21.475110 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:21.475816 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:21.476315 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:21.476759 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:21.608412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:21.616898 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2f8775db-53b8-4334-abcd-b51a292861d0 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.154009 Sep 24 15:06:21.617461 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 428/865] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:21 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:22.639745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:22.640286 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:22.643246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=50 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:22.648909 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:22.649403 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:22.649846 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:22.650575 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:22.651036 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:22.651511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:22.780013 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:22.787705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e65284e2-86e2-4ef2-bcd1-836efbe94172 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.151925 Sep 24 15:06:22.788275 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 438/866] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:22 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:23.811491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:23.812612 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:23.819509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:23.820008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:23.820485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:23.821195 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:23.821665 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:23.822145 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:23.959520 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:23.967392 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-19448f12-f0e6-4ce7-a1fd-bab5cd367ea3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.159766 Sep 24 15:06:23.968210 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 429/867] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:23 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:24.990955 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:24.991767 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:24.998211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:24.998712 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:24.999157 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:24.999857 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:25.000322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:25.000756 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:25.128340 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:25.136065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2dddb357-78f4-48e2-acf0-b91405522093 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.149010 Sep 24 15:06:25.136635 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 439/868] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:24 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:25.478090 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-221367362"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:25.478645 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:25.485062 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:25.485561 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:25.486032 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:25.486739 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:25.487203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:25.487638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:25.509297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-1acedbd9-f02a-42af-a4d2-9746f0b5e207 req-945b6cdd-8c3f-4358-8dcc-c86d614488aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775dbe6e-e603-4a12-84b4-3bae6637954d", "name": "network-vif-plugged", "status": "completed", "tag": "10e26e89-d2cf-44a3-8d75-3fdc714831ff"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:25.520406 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-1acedbd9-f02a-42af-a4d2-9746f0b5e207 req-945b6cdd-8c3f-4358-8dcc-c86d614488aa service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:25.520904 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-1acedbd9-f02a-42af-a4d2-9746f0b5e207 req-945b6cdd-8c3f-4358-8dcc-c86d614488aa service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:25.521351 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-1acedbd9-f02a-42af-a4d2-9746f0b5e207 req-945b6cdd-8c3f-4358-8dcc-c86d614488aa service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:25.533704 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-1acedbd9-f02a-42af-a4d2-9746f0b5e207 req-945b6cdd-8c3f-4358-8dcc-c86d614488aa service nova] Creating event network-vif-plugged:10e26e89-d2cf-44a3-8d75-3fdc714831ff for instance 775dbe6e-e603-4a12-84b4-3bae6637954d on hv-cinder-85919 Sep 24 15:06:25.538745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-1acedbd9-f02a-42af-a4d2-9746f0b5e207 req-945b6cdd-8c3f-4358-8dcc-c86d614488aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Sep 24 15:06:25.539614 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 440/869] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:06:25.646311 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.network.security_group_api [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Removing security group 8519b741-7242-45e6-b5df-9b6974f5bf09 from port e260da27-bebb-41f0-843b-c81f7ae57657 Sep 24 15:06:25.769526 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:25.770245 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:25.776390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:25.776984 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:25.777638 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:25.778449 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:25.778987 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:25.779493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:25.871329 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lazy-loading 'services' on Instance uuid 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:06:25.953062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a41d7292-df89-464e-b729-3af45cacfa09 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments/fc47a417-418a-49d8-9f8a-661ef6578123" status: 202 len: 0 microversion: 2.1 time: 0.187926 Sep 24 15:06:25.953647 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 441/870] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:06:25 2022] DELETE /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments/fc47a417-418a-49d8-9f8a-661ef6578123 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 15:06:25.962283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-12120098-d6b2-445d-899b-229c09cc86e1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:25.964570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-12120098-d6b2-445d-899b-229c09cc86e1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:25.970706 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12120098-d6b2-445d-899b-229c09cc86e1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:25.971206 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12120098-d6b2-445d-899b-229c09cc86e1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:25.971654 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12120098-d6b2-445d-899b-229c09cc86e1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:25.972358 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12120098-d6b2-445d-899b-229c09cc86e1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:25.972824 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12120098-d6b2-445d-899b-229c09cc86e1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:25.973258 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-12120098-d6b2-445d-899b-229c09cc86e1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:26.003745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-12120098-d6b2-445d-899b-229c09cc86e1 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045649 Sep 24 15:06:26.004415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 442/871] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:06:25 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:26.025233 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-00d89170-0021-464d-b772-b84267cf2847 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "POST /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/action" status: 202 len: 0 microversion: 2.1 time: 0.551090 Sep 24 15:06:26.025952 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 430/872] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:06:25 2022] POST /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:06:26.161076 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:26.161701 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:26.168353 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:26.168848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:26.170478 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:26.171813 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:26.172938 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:26.173728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:26.185022 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-e34d03ef-9d9c-4432-82a4-1c48d3b7d516 req-a2713b57-1c86-43e2-9625-a2be15927520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27149a7e-4568-4ef5-889a-deae9c4c99f4", "tag": "e260da27-bebb-41f0-843b-c81f7ae57657"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:26.197135 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-e34d03ef-9d9c-4432-82a4-1c48d3b7d516 req-a2713b57-1c86-43e2-9625-a2be15927520 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:26.197952 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-e34d03ef-9d9c-4432-82a4-1c48d3b7d516 req-a2713b57-1c86-43e2-9625-a2be15927520 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:26.198701 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-e34d03ef-9d9c-4432-82a4-1c48d3b7d516 req-a2713b57-1c86-43e2-9625-a2be15927520 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:26.234430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-e34d03ef-9d9c-4432-82a4-1c48d3b7d516 req-a2713b57-1c86-43e2-9625-a2be15927520 service nova] Creating event network-changed:e260da27-bebb-41f0-843b-c81f7ae57657 for instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 on hv-cinder-85919 Sep 24 15:06:26.241677 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-e34d03ef-9d9c-4432-82a4-1c48d3b7d516 req-a2713b57-1c86-43e2-9625-a2be15927520 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211758 Sep 24 15:06:26.242952 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 443/873] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:06:26.435575 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:26.443825 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-48cedca7-6913-4e63-8709-d03b7e36b18f tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1576 microversion: 2.1 time: 0.287002 Sep 24 15:06:26.444397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 431/874] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:26 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1576 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:06:27.016899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f57b67f9-b1a3-4c39-994e-e325478e9b51 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:27.019294 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f57b67f9-b1a3-4c39-994e-e325478e9b51 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:27.026017 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f57b67f9-b1a3-4c39-994e-e325478e9b51 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:27.026584 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f57b67f9-b1a3-4c39-994e-e325478e9b51 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:27.027097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f57b67f9-b1a3-4c39-994e-e325478e9b51 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:27.027872 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f57b67f9-b1a3-4c39-994e-e325478e9b51 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:27.028419 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f57b67f9-b1a3-4c39-994e-e325478e9b51 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:27.028919 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f57b67f9-b1a3-4c39-994e-e325478e9b51 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:27.060111 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f57b67f9-b1a3-4c39-994e-e325478e9b51 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047554 Sep 24 15:06:27.064868 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 444/875] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:06:27 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:27.347984 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:27.348489 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:27.354852 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:27.355338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:27.355804 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:27.356500 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:27.356966 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:27.357387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:27.441260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lazy-loading 'services' on Instance uuid 27149a7e-4568-4ef5-889a-deae9c4c99f4 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:06:27.466965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:27.467552 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:27.474089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:27.474582 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:27.475022 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:27.475732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:27.477133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:27.477133 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:27.522149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-077c52ea-8960-4a45-bf53-64c2157888d6 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "DELETE /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments/c98bc0a2-cc4e-4bca-a28f-9bc829d7764a" status: 202 len: 0 microversion: 2.1 time: 0.178535 Sep 24 15:06:27.526134 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 432/876] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:06:27 2022] DELETE /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments/c98bc0a2-cc4e-4bca-a28f-9bc829d7764a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:06:27.541073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-70fcf433-5a98-4443-8c50-74294b18c793 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:27.544500 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-70fcf433-5a98-4443-8c50-74294b18c793 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:27.553762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70fcf433-5a98-4443-8c50-74294b18c793 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:27.554412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70fcf433-5a98-4443-8c50-74294b18c793 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:27.554898 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70fcf433-5a98-4443-8c50-74294b18c793 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:27.555733 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70fcf433-5a98-4443-8c50-74294b18c793 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:27.556871 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70fcf433-5a98-4443-8c50-74294b18c793 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:27.557495 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-70fcf433-5a98-4443-8c50-74294b18c793 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:27.591601 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-70fcf433-5a98-4443-8c50-74294b18c793 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063932 Sep 24 15:06:27.592366 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 433/877] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:06:27 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:27.619777 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:27.628484 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f5e66976-97c3-43a8-a688-54416e1027c5 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1563 microversion: 2.1 time: 0.165242 Sep 24 15:06:27.629161 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 445/878] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:27 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:06:28.072842 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-143a55ec-9874-468e-aa47-bb2ac2d18e11 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:28.075405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-143a55ec-9874-468e-aa47-bb2ac2d18e11 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:28.082290 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-143a55ec-9874-468e-aa47-bb2ac2d18e11 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:28.082787 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-143a55ec-9874-468e-aa47-bb2ac2d18e11 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:28.083237 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-143a55ec-9874-468e-aa47-bb2ac2d18e11 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:28.083950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-143a55ec-9874-468e-aa47-bb2ac2d18e11 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:28.084419 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-143a55ec-9874-468e-aa47-bb2ac2d18e11 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:28.084853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-143a55ec-9874-468e-aa47-bb2ac2d18e11 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:28.117725 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-143a55ec-9874-468e-aa47-bb2ac2d18e11 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048670 Sep 24 15:06:28.118703 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 434/879] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:06:28 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:28.262172 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-10ced9e3-9c9e-4238-99a0-114efa934170 req-55b624cd-c1d7-4cc1-b625-b48ef49aafa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27149a7e-4568-4ef5-889a-deae9c4c99f4", "tag": "e260da27-bebb-41f0-843b-c81f7ae57657"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:28.277925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-10ced9e3-9c9e-4238-99a0-114efa934170 req-55b624cd-c1d7-4cc1-b625-b48ef49aafa5 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:28.278594 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-10ced9e3-9c9e-4238-99a0-114efa934170 req-55b624cd-c1d7-4cc1-b625-b48ef49aafa5 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:28.279156 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-10ced9e3-9c9e-4238-99a0-114efa934170 req-55b624cd-c1d7-4cc1-b625-b48ef49aafa5 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:28.291794 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-10ced9e3-9c9e-4238-99a0-114efa934170 req-55b624cd-c1d7-4cc1-b625-b48ef49aafa5 service nova] Creating event network-changed:e260da27-bebb-41f0-843b-c81f7ae57657 for instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 on hv-cinder-85919 Sep 24 15:06:28.296668 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-10ced9e3-9c9e-4238-99a0-114efa934170 req-55b624cd-c1d7-4cc1-b625-b48ef49aafa5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038404 Sep 24 15:06:28.297630 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 446/880] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:28.605271 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-890847d8-d2aa-4111-b564-3e1c615608c1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:28.607481 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-890847d8-d2aa-4111-b564-3e1c615608c1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:28.613507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-890847d8-d2aa-4111-b564-3e1c615608c1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:28.614031 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-890847d8-d2aa-4111-b564-3e1c615608c1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:28.614474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-890847d8-d2aa-4111-b564-3e1c615608c1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:28.615175 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-890847d8-d2aa-4111-b564-3e1c615608c1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:28.615637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-890847d8-d2aa-4111-b564-3e1c615608c1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:28.616069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-890847d8-d2aa-4111-b564-3e1c615608c1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:28.649500 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-890847d8-d2aa-4111-b564-3e1c615608c1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048692 Sep 24 15:06:28.650097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 435/881] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:06:28 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:29.130738 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b598fe9b-6759-415a-ae19-4e353ec9cc14 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:29.133105 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b598fe9b-6759-415a-ae19-4e353ec9cc14 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:29.139432 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b598fe9b-6759-415a-ae19-4e353ec9cc14 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.139956 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b598fe9b-6759-415a-ae19-4e353ec9cc14 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.140407 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b598fe9b-6759-415a-ae19-4e353ec9cc14 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.141119 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b598fe9b-6759-415a-ae19-4e353ec9cc14 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.141582 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b598fe9b-6759-415a-ae19-4e353ec9cc14 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.142052 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b598fe9b-6759-415a-ae19-4e353ec9cc14 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.159645 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:29.174446 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b598fe9b-6759-415a-ae19-4e353ec9cc14 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048163 Sep 24 15:06:29.175021 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 447/882] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:06:29 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 15:06:29.238403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:29.238912 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:29.245029 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.245531 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.246011 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.246759 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.247229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.247688 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.251717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:29.273398 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:06:29.347683 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-17a4dd93-81bb-4e3f-9c20-8251051c4c5f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 204 len: 0 microversion: 2.1 time: 0.112726 Sep 24 15:06:29.348750 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 436/883] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:06:29 2022] DELETE /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 15:06:29.356747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:29.357374 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:29.365457 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.365979 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.366690 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.367425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.367897 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.368361 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.502517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:29.510051 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-80c0e33c-6435-40a8-8def-7f1336213189 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1681 microversion: 2.1 time: 0.157099 Sep 24 15:06:29.510613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 448/884] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:29 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:29.663340 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fc2162f9-ef29-48c8-9341-f031028ea64a tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:29.665503 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fc2162f9-ef29-48c8-9341-f031028ea64a tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:29.671849 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fc2162f9-ef29-48c8-9341-f031028ea64a tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.672336 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fc2162f9-ef29-48c8-9341-f031028ea64a tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.672811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fc2162f9-ef29-48c8-9341-f031028ea64a tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.673481 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fc2162f9-ef29-48c8-9341-f031028ea64a tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.673967 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fc2162f9-ef29-48c8-9341-f031028ea64a tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.674403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fc2162f9-ef29-48c8-9341-f031028ea64a tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.704033 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fc2162f9-ef29-48c8-9341-f031028ea64a tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045119 Sep 24 15:06:29.704595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 437/885] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:06:29 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 15:06:29.715134 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:29.715632 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:29.722008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.722505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.722945 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.723636 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:29.724093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:29.724520 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:29.797040 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] HTTP exception thrown: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 is not attached to volume c98bc0a2-cc4e-4bca-a28f-9bc829d7764a Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Request method failure captured: Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: DELETE /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments/c98bc0a2-cc4e-4bca-a28f-9bc829d7764a HTTP/1.1 Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxxs_GSJtYOXLExgcthcFPSQ890VfoSCICvhFVslyypxuqDqRJxJN4E--A0521m5XfMYqDuJ4NRM5eZHXXFsVeZa1bVOYQZerzaNdebMWUQ7AWVLXyTS9bkX93cYr0K1YmF7p3UFguBE5c44-nxUqiGdHBaa6MrdadGfn1p7HaNabrU Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 1afc2cc56fef4d5aa0e0905ef059d123 Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-TestMinimumBasicScenario-575838537 Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:06:29.813225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1afc2cc56fef4d5aa0e0905ef059d123"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1afc2cc56fef4d5aa0e0905ef059d123"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1afc2cc56fef4d5aa0e0905ef059d123"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1afc2cc56fef4d5aa0e0905ef059d123"}]}] Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-TestMinimumBasicScenario-575838537 Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 1afc2cc56fef4d5aa0e0905ef059d123 Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-TestMinimumBasicScenario-575838537 Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-TestMinimumBasicScenario-575838537-project Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 4e9a50200076443d98841a76e961408b Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-TestMinimumBasicScenario-575838537-project Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:06:29.815018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 is not attached to volume c98bc0a2-cc4e-4bca-a28f-9bc829d7764a Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'server_id': '27149a7e-4568-4ef5-889a-deae9c4c99f4', 'id': 'c98bc0a2-cc4e-4bca-a28f-9bc829d7764a'} Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c98bc0a2-cc4e-4bca-a28f-9bc829d7764a. Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:29.815925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 is not attached to volume c98bc0a2-cc4e-4bca-a28f-9bc829d7764a Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 is not attached to volume c98bc0a2-cc4e-4bca-a28f-9bc829d7764a Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:29.817750 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Returning 404 to user: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 is not attached to volume c98bc0a2-cc4e-4bca-a28f-9bc829d7764a {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:29.819180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9b16657c-84ce-4727-9b1d-105cb23d0e77 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "DELETE /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments/c98bc0a2-cc4e-4bca-a28f-9bc829d7764a" status: 404 len: 154 microversion: 2.1 time: 0.103500 Sep 24 15:06:29.819180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 449/886] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:06:29 2022] DELETE /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4/os-volume_attachments/c98bc0a2-cc4e-4bca-a28f-9bc829d7764a => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:06:30.534898 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:30.535443 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:30.541334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:30.541823 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:30.542302 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:30.543005 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:30.543472 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:30.543909 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:30.673963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:30.681526 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d82ba8ff-9f8e-4b3d-8a70-fa269b741787 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1681 microversion: 2.1 time: 0.151319 Sep 24 15:06:30.682114 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 438/887] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:30 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:30.958674 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:30.959182 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:30.965814 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:30.966337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:30.966786 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:30.967488 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:30.968592 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:30.969029 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:30.994122 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Going to try to terminate instance {{(pid=120590) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:06:31.066934 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6bf67f5b-fe4c-4c3d-ae0f-0fdbffb595f7 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "DELETE /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 204 len: 0 microversion: 2.1 time: 0.111848 Sep 24 15:06:31.067511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 450/888] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:06:30 2022] DELETE /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:06:31.075622 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:31.076242 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:31.082700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:31.083191 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:31.083635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:31.084328 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:31.084791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:31.085222 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:31.219446 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:31.227235 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-c56da3ee-5add-4ea0-84d8-2bc04703b0a8 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1554 microversion: 2.1 time: 0.155335 Sep 24 15:06:31.227730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 439/889] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:31 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:31.705278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:31.706012 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:31.711926 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:31.712440 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:31.712869 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:31.713567 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:31.714060 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:31.714498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:31.840082 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:31.847787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-cc69fc11-e7b6-464a-8062-a39a9f5ec21f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1681 microversion: 2.1 time: 0.146794 Sep 24 15:06:31.848367 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 451/890] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:31 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:32.250426 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:32.251065 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:32.257619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:32.258141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:32.258582 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:32.259265 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:32.259721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:32.260144 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:32.385879 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:32.394117 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e445a78e-66fb-4a45-be4b-7f557e2eeac2 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1554 microversion: 2.1 time: 0.147542 Sep 24 15:06:32.394690 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 440/891] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:32 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:32.871221 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:32.871838 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:32.878863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:32.879360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:32.879803 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:32.880507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:32.880969 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:32.881402 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:33.018322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:33.026091 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-78b0e234-b018-4878-a0b1-724cff242ea4 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1681 microversion: 2.1 time: 0.158685 Sep 24 15:06:33.026686 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 452/892] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:32 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:33.417892 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:33.418533 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:33.425303 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:33.425717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:33.426193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:33.426897 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:33.427352 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:33.427779 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:33.564872 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:33.572968 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bf52e872-aff2-4828-b42a-cb6f8c155c60 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1554 microversion: 2.1 time: 0.158975 Sep 24 15:06:33.573558 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 441/893] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:33 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:34.049408 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:34.050043 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:34.056314 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:34.056828 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:34.057256 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:34.057983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:34.058451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:34.058883 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:34.327417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-c8398ccc-dbc9-40ac-80cf-a74a92011887 req-c2680206-c04a-4bdb-a25a-e0ec9a5be264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27149a7e-4568-4ef5-889a-deae9c4c99f4", "name": "network-vif-deleted", "tag": "e260da27-bebb-41f0-843b-c81f7ae57657"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:34.337214 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-c8398ccc-dbc9-40ac-80cf-a74a92011887 req-c2680206-c04a-4bdb-a25a-e0ec9a5be264 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:34.337892 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-c8398ccc-dbc9-40ac-80cf-a74a92011887 req-c2680206-c04a-4bdb-a25a-e0ec9a5be264 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:34.338388 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-c8398ccc-dbc9-40ac-80cf-a74a92011887 req-c2680206-c04a-4bdb-a25a-e0ec9a5be264 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:34.351007 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-c8398ccc-dbc9-40ac-80cf-a74a92011887 req-c2680206-c04a-4bdb-a25a-e0ec9a5be264 service nova] Creating event network-vif-deleted:e260da27-bebb-41f0-843b-c81f7ae57657 for instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 on hv-cinder-85919 Sep 24 15:06:34.355676 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-c8398ccc-dbc9-40ac-80cf-a74a92011887 req-c2680206-c04a-4bdb-a25a-e0ec9a5be264 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031969 Sep 24 15:06:34.356427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 442/894] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:06:34.399351 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:34.407787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b8be218f-05ed-42b4-8957-5cd078eb8f4f tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1681 microversion: 2.1 time: 0.362788 Sep 24 15:06:34.408363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 453/895] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:34 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1681 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:34.598378 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:34.599092 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:34.614219 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:34.614731 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:34.615183 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:34.615923 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:34.616652 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:34.617090 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:34.656137 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:34.656780 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:34.657327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:34.658180 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lazy-loading 'fault' on Instance uuid 27149a7e-4568-4ef5-889a-deae9c4c99f4 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:06:34.710664 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9a50200076443d98841a76e961408b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afc2cc56fef4d5aa0e0905ef059d123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:34.720366 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-137429e2-e138-4541-bb04-4bf18549135f tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 200 len: 1348 microversion: 2.1 time: 0.126681 Sep 24 15:06:34.721317 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 443/896] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:34 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 1348 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:35.431404 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:35.432673 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:35.440098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:35.440602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:35.441046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:35.442090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:35.442549 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:35.442990 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:35.478497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:35.478994 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:35.479841 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:35.480006 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lazy-loading 'fault' on Instance uuid 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:06:35.531179 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f74f51060554db18bc96199222e9261', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b2919ee12fe488ea94db84e9af057a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:35.539392 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fe93dfa6-6f10-486d-888b-338b96c8b64d tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 200 len: 1332 microversion: 2.1 time: 0.111963 Sep 24 15:06:35.539974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 454/897] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:35 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:35.743215 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:35.743828 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] [instance: 27149a7e-4568-4ef5-889a-deae9c4c99f4] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:35.751337 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:35.751835 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:35.752286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:35.752988 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:35.753455 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:35.753892 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:35.767112 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] HTTP exception thrown: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 could not be found. Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Request method failure captured: Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 HTTP/1.1 Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxxs_GSJtYOXLExgcthcFPSQ890VfoSCICvhFVslyypxuqDqRJxJN4E--A0521m5XfMYqDuJ4NRM5eZHXXFsVeZa1bVOYQZerzaNdebMWUQ7AWVLXyTS9bkX93cYr0K1YmF7p3UFguBE5c44-nxUqiGdHBaa6MrdadGfn1p7HaNabrU Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 1afc2cc56fef4d5aa0e0905ef059d123 Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-TestMinimumBasicScenario-575838537 Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:06:35.768753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1afc2cc56fef4d5aa0e0905ef059d123"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1afc2cc56fef4d5aa0e0905ef059d123"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1afc2cc56fef4d5aa0e0905ef059d123"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1afc2cc56fef4d5aa0e0905ef059d123"}]}] Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-TestMinimumBasicScenario-575838537 Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 1afc2cc56fef4d5aa0e0905ef059d123 Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-TestMinimumBasicScenario-575838537 Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-TestMinimumBasicScenario-575838537-project Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 4e9a50200076443d98841a76e961408b Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-TestMinimumBasicScenario-575838537-project Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 could not be found. Sep 24 15:06:35.770404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '27149a7e-4568-4ef5-889a-deae9c4c99f4'} Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 could not be found. Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:35.771254 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 could not be found. Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 could not be found. Sep 24 15:06:35.772979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:35.774329 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Returning 404 to user: Instance 27149a7e-4568-4ef5-889a-deae9c4c99f4 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:35.774329 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ec79e564-a3c7-42e2-b05d-0bd52d609e1c tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4" status: 404 len: 111 microversion: 2.1 time: 0.031228 Sep 24 15:06:35.774329 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 444/898] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:35 2022] GET /compute/v2.1/servers/27149a7e-4568-4ef5-889a-deae9c4c99f4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:06:35.778846 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5eadb927-46aa-4439-8aca-baa37a5335e1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] Calling method '.version_select at 0x7f7c143f7f70>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:35.798180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5eadb927-46aa-4439-8aca-baa37a5335e1 tempest-TestMinimumBasicScenario-575838537 tempest-TestMinimumBasicScenario-575838537-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1464457337" status: 202 len: 0 microversion: 2.1 time: 0.023088 Sep 24 15:06:35.798746 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 455/899] 10.222.0.61 () {58 vars in 1272 bytes} [Sat Sep 24 15:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1464457337 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:06:36.374314 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-b0d720c4-4b3c-4fab-a16e-3761a52f70dd req-af0bad73-33f2-4c66-ba3c-e1c84d9061d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68dcfbd6-61c3-46e6-9bab-42fc5b2ede39", "name": "network-vif-deleted", "tag": "78b562bf-66a7-4369-88a3-a0823798cc5f"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:36.383613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b0d720c4-4b3c-4fab-a16e-3761a52f70dd req-af0bad73-33f2-4c66-ba3c-e1c84d9061d8 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:36.384098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b0d720c4-4b3c-4fab-a16e-3761a52f70dd req-af0bad73-33f2-4c66-ba3c-e1c84d9061d8 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:36.384536 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-b0d720c4-4b3c-4fab-a16e-3761a52f70dd req-af0bad73-33f2-4c66-ba3c-e1c84d9061d8 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:36.396074 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-b0d720c4-4b3c-4fab-a16e-3761a52f70dd req-af0bad73-33f2-4c66-ba3c-e1c84d9061d8 service nova] Creating event network-vif-deleted:78b562bf-66a7-4369-88a3-a0823798cc5f for instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 on hv-cinder-85919 Sep 24 15:06:36.400959 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-b0d720c4-4b3c-4fab-a16e-3761a52f70dd req-af0bad73-33f2-4c66-ba3c-e1c84d9061d8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030506 Sep 24 15:06:36.401550 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 445/900] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:36.566083 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:36.566623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:36.572605 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:36.573094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:36.573533 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:36.574248 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:36.574702 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:36.575127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:36.589718 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 HTTP/1.1 Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:06:36.591431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:36.592995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '68dcfbd6-61c3-46e6-9bab-42fc5b2ede39'} Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:36.593855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:36.595071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:36.596602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:36.596602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b5689984-f89f-45a4-8155-8058e0171d0a tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 404 len: 111 microversion: 2.1 time: 0.031759 Sep 24 15:06:36.596602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 456/901] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:36 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 15:06:36.602625 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-46490e18-89c1-426e-8643-55ab55d48152 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '.version_select at 0x7f7c10975310>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:36.622715 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-46490e18-89c1-426e-8643-55ab55d48152 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050048519" status: 202 len: 0 microversion: 2.1 time: 0.024212 Sep 24 15:06:36.623299 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 446/902] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Sep 24 15:06:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050048519 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:06:38.425089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:38.425583 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:38.432161 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:38.432660 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:38.433108 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:38.433817 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:38.434307 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:38.434747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:38.448832 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: DELETE /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 HTTP/1.1 Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:06:38.450425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.452010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '68dcfbd6-61c3-46e6-9bab-42fc5b2ede39'} Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:38.452815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.454097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.455284 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:38.455284 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4a2ad718-41d0-4b8f-b101-1e5afb1c9193 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 404 len: 111 microversion: 2.1 time: 0.031270 Sep 24 15:06:38.455284 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 457/903] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:06:38 2022] DELETE /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:06:38.460947 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:38.461700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:38.467814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:38.468311 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:38.468758 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:38.469466 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:38.469959 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:38.470402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:38.490181 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 HTTP/1.1 Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:06:38.492696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.494295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '68dcfbd6-61c3-46e6-9bab-42fc5b2ede39'} Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:38.495154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. Sep 24 15:06:38.496922 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:38.499711 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance 68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:38.499711 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-45f24f06-9f04-4983-9003-aa0aaa069d70 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39" status: 404 len: 111 microversion: 2.1 time: 0.037613 Sep 24 15:06:38.499711 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 447/904] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:38 2022] GET /compute/v2.1/servers/68dcfbd6-61c3-46e6-9bab-42fc5b2ede39 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 15:06:39.649566 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:39.650105 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:39.656472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:39.656967 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:39.657408 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:39.658146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:39.658611 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:39.659044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:39.672260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: DELETE /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 HTTP/1.1 Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:06:39.673804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.675348 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '4ad8e4f1-7caf-4e74-9f35-d2691ea22437'} Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:39.676150 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.677570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.678929 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:39.678929 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d4781abd-0998-4f58-b3fb-72f5830d4950 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 404 len: 111 microversion: 2.1 time: 0.029588 Sep 24 15:06:39.678929 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 458/905] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:06:39 2022] DELETE /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 15:06:39.683672 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:39.684300 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 4ad8e4f1-7caf-4e74-9f35-d2691ea22437] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:39.691376 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:39.691879 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:39.692326 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:39.693037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:39.693505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:39.693962 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:39.708158 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 HTTP/1.1 Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:06:39.709704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.711040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '4ad8e4f1-7caf-4e74-9f35-d2691ea22437'} Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:39.711796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. Sep 24 15:06:39.713004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.714203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance 4ad8e4f1-7caf-4e74-9f35-d2691ea22437 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:39.714203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-98d3ec9a-5b17-44a4-a3da-a558c8de8970 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437" status: 404 len: 111 microversion: 2.1 time: 0.031319 Sep 24 15:06:39.714203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 448/906] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:39 2022] GET /compute/v2.1/servers/4ad8e4f1-7caf-4e74-9f35-d2691ea22437 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:06:39.719958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:39.720402 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:39.726390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:39.726886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:39.727324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:39.728055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:39.728517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:39.728946 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:39.742706 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: DELETE /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed HTTP/1.1 Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:06:39.744324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.745829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '2e9dbe91-58e2-4672-9c57-0ad669724eed'} Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:39.747207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.748433 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.750220 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:39.750220 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3f487dc3-fba7-4a5c-978d-1eadd1d825ae tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 404 len: 111 microversion: 2.1 time: 0.029724 Sep 24 15:06:39.750220 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 459/907] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:06:39 2022] DELETE /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:06:39.756187 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:39.756868 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: 2e9dbe91-58e2-4672-9c57-0ad669724eed] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:39.764282 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:39.764885 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:39.765407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:39.766236 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:39.766766 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:39.767264 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:39.781498 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed HTTP/1.1 Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:06:39.783459 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.785043 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '2e9dbe91-58e2-4672-9c57-0ad669724eed'} Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:39.785950 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. Sep 24 15:06:39.787380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:39.788666 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance 2e9dbe91-58e2-4672-9c57-0ad669724eed could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:39.788666 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0a9abf3f-b59c-4c97-ab00-375933ba106e tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed" status: 404 len: 111 microversion: 2.1 time: 0.033639 Sep 24 15:06:39.788666 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 449/908] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:39 2022] GET /compute/v2.1/servers/2e9dbe91-58e2-4672-9c57-0ad669724eed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:06:40.949028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:40.949530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:40.960812 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:40.961318 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:40.961770 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:40.962534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:40.963181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:40.963787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:40.982928 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: DELETE /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 HTTP/1.1 Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:06:40.984590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:40.986273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'ab04a4f5-03a9-4af4-b050-f54f2f0821b8'} Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:40.987197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:40.988689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:40.991925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:40.992821 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9342692c-1af9-48d1-9135-3c4d04c759bc tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 404 len: 111 microversion: 2.1 time: 0.047772 Sep 24 15:06:40.994440 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 460/909] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:06:40 2022] DELETE /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:06:41.002972 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:41.003722 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] [instance: ab04a4f5-03a9-4af4-b050-f54f2f0821b8] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:41.010894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:41.011393 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:41.011834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:41.012532 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:41.012991 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:41.013421 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:41.028039 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] HTTP exception thrown: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Request method failure captured: Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 HTTP/1.1 Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxtwUK9_-_4deDczqyuL-RfLFqJZJ9RIMWTmKRocjumT8AbjNT3kGmOjYia96bEDZ-SM0V3SmGY8iHORGva3EQJCoMMfZWLGacSCUSUALFsqChWlK-60AC5OPEn09JHBzwHfrKPQy-oSaE_7TWx4dg9dKLqJioIY1AcHTgtzdHod22Q Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:06:41.029613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9b2919ee12fe488ea94db84e9af057a2"}]}] Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 9b2919ee12fe488ea94db84e9af057a2 Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1189904618 Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 9f74f51060554db18bc96199222e9261 Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeNegativeTest-1189904618-project Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:41.031297 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': 'ab04a4f5-03a9-4af4-b050-f54f2f0821b8'} Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:41.032121 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. Sep 24 15:06:41.033544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:41.035131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] Returning 404 to user: Instance ab04a4f5-03a9-4af4-b050-f54f2f0821b8 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:41.035131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2d80b54b-f241-45c9-87ab-ba4c20a4daa0 tempest-AttachVolumeNegativeTest-1189904618 tempest-AttachVolumeNegativeTest-1189904618-project] 10.222.0.61 "GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8" status: 404 len: 111 microversion: 2.1 time: 0.032954 Sep 24 15:06:41.035131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 450/910] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:06:40 2022] GET /compute/v2.1/servers/ab04a4f5-03a9-4af4-b050-f54f2f0821b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 15:06:48.680478 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d5223f27-57b9-4a73-90a7-dad35f05d511 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:48.682828 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d5223f27-57b9-4a73-90a7-dad35f05d511 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:48.693657 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5223f27-57b9-4a73-90a7-dad35f05d511 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:48.693957 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5223f27-57b9-4a73-90a7-dad35f05d511 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:48.694315 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5223f27-57b9-4a73-90a7-dad35f05d511 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:48.694973 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5223f27-57b9-4a73-90a7-dad35f05d511 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:48.695526 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5223f27-57b9-4a73-90a7-dad35f05d511 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:48.695970 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d5223f27-57b9-4a73-90a7-dad35f05d511 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:48.731526 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d5223f27-57b9-4a73-90a7-dad35f05d511 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055178 Sep 24 15:06:48.732321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 461/911] 10.222.0.61 () {60 vars in 1343 bytes} [Sat Sep 24 15:06:48 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:06:48.828010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:48.829179 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:48.837178 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:48.842111 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:48.843079 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:48.844213 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:48.845565 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:48.846315 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:48.847649 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:48.883932 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:06:49.021865 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f94ccb2a-2844-4fa4-9d00-053033adefa4 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 204 len: 0 microversion: 2.20 time: 0.203056 Sep 24 15:06:49.022489 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 451/912] 10.222.0.61 () {60 vars in 1280 bytes} [Sat Sep 24 15:06:48 2022] DELETE /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 15:06:49.031056 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:49.031949 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:49.038287 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:49.038797 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:49.039251 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:49.039979 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:49.040450 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:49.040890 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:49.267472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:49.279267 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:49.282756 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:49.283925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3ba90e76-f938-4e74-bc4c-34c7fd53d4fa tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.256949 Sep 24 15:06:49.284936 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 462/913] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:49 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:50.316050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:50.318025 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:50.331689 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:50.332486 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:50.333036 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:50.334557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:50.335261 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:50.336000 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:50.608332 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:50.621551 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:50.623069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:50.624478 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4393fbe6-7b30-4d03-8d11-69238bca6765 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.316610 Sep 24 15:06:50.625052 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 452/914] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:50 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:51.652188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:51.653497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:51.664914 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:51.666279 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:51.667292 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:51.668297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:51.671309 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:51.672693 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:51.848080 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:51.860903 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:51.862724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:51.864023 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c3f63edb-a3bf-41c8-84ab-ba4e473a8c86 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.217294 Sep 24 15:06:51.864574 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 463/915] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:51 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:52.893108 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:52.893936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:52.903814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:52.904676 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:52.906186 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:52.907696 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:52.908390 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:52.909552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:53.248313 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:53.259823 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:53.263568 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:53.265762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a3f7a932-4033-4348-97a6-73969b75d076 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.378777 Sep 24 15:06:53.270045 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 453/916] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:52 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:54.302805 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:54.305506 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:54.323057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:54.326460 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:54.333008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:54.333815 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:54.334627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:54.335099 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:54.335537 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:54.560091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-71ccdb9f-819e-4a72-b1b5-09454ec9fd87 req-5715a6e3-d935-4554-93b8-4ab8f8743153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f0888f-6da8-42cb-826c-506383e4bd08", "name": "network-vif-unplugged", "status": "completed", "tag": "63e76081-8d75-427d-84e4-cb30841ec95f"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:54.582834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-71ccdb9f-819e-4a72-b1b5-09454ec9fd87 req-5715a6e3-d935-4554-93b8-4ab8f8743153 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:54.585819 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-71ccdb9f-819e-4a72-b1b5-09454ec9fd87 req-5715a6e3-d935-4554-93b8-4ab8f8743153 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:54.591312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-71ccdb9f-819e-4a72-b1b5-09454ec9fd87 req-5715a6e3-d935-4554-93b8-4ab8f8743153 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:54.620469 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-71ccdb9f-819e-4a72-b1b5-09454ec9fd87 req-5715a6e3-d935-4554-93b8-4ab8f8743153 service nova] Creating event network-vif-unplugged:63e76081-8d75-427d-84e4-cb30841ec95f for instance a4f0888f-6da8-42cb-826c-506383e4bd08 on hv-cinder-85919 Sep 24 15:06:54.635078 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-71ccdb9f-819e-4a72-b1b5-09454ec9fd87 req-5715a6e3-d935-4554-93b8-4ab8f8743153 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080311 Sep 24 15:06:54.636758 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 454/917] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:06:54.801988 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:54.812839 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:54.814322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdbc898ffd4f4d5d87c3684fcc17313d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea560f6e50034738b03e588ada15e940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:06:54.815910 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6f417691-b120-4bf0-827b-a0ab6704d014 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 200 len: 1724 microversion: 2.20 time: 0.521958 Sep 24 15:06:54.816432 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 464/918] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:54 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 1724 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 15:06:55.416522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-374d54c8-ba6f-45b1-a44c-7f77a2118c34 req-4700969b-5838-49dd-82ef-a0518ff739e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4f0888f-6da8-42cb-826c-506383e4bd08", "name": "network-vif-deleted", "tag": "63e76081-8d75-427d-84e4-cb30841ec95f"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:55.453008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-374d54c8-ba6f-45b1-a44c-7f77a2118c34 req-4700969b-5838-49dd-82ef-a0518ff739e3 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:55.453582 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-374d54c8-ba6f-45b1-a44c-7f77a2118c34 req-4700969b-5838-49dd-82ef-a0518ff739e3 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:55.453997 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-374d54c8-ba6f-45b1-a44c-7f77a2118c34 req-4700969b-5838-49dd-82ef-a0518ff739e3 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:55.483264 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-374d54c8-ba6f-45b1-a44c-7f77a2118c34 req-4700969b-5838-49dd-82ef-a0518ff739e3 service nova] Creating event network-vif-deleted:63e76081-8d75-427d-84e4-cb30841ec95f for instance a4f0888f-6da8-42cb-826c-506383e4bd08 on hv-cinder-85919 Sep 24 15:06:55.493762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-374d54c8-ba6f-45b1-a44c-7f77a2118c34 req-4700969b-5838-49dd-82ef-a0518ff739e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087034 Sep 24 15:06:55.495204 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 455/919] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:55.845705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:55.847898 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:55.871164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:55.871909 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:55.872943 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:55.876777 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:55.877338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:55.878162 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:55.905794 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] HTTP exception thrown: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Request method failure captured: Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 HTTP/1.1 Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtzwCvVwOnNOWLZxYO9KOp0CZ6HLnItxmEaFGvNQAkwpiP1M5KLatXw_G_kfbZHvvxOCLz-uuO6XNNOCE_CNeZ0Lnh_e4TCLH6WHgjIQoKZQeCpHZAJgWaCCFz6yaPT9DMawDERIXBp--9G50u27PcXej1U1I9khxeYA6JvVImt7qI Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:06:55.907743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea560f6e50034738b03e588ada15e940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea560f6e50034738b03e588ada15e940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}] Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: cdbc898ffd4f4d5d87c3684fcc17313d Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:55.909225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'a4f0888f-6da8-42cb-826c-506383e4bd08'} Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:55.910188 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:55.911658 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:55.913036 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Returning 404 to user: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:55.913036 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-de06878e-c6c8-418a-b957-ecacf6a8b454 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 404 len: 111 microversion: 2.20 time: 0.071105 Sep 24 15:06:55.913243 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 465/920] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:55 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 15:06:55.934797 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9348c1c6-1aad-47f4-bcbf-b8605758b05e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '.version_select at 0x7f7c10b4c1f0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:55.960594 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9348c1c6-1aad-47f4-bcbf-b8605758b05e tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-319960541" status: 204 len: 0 microversion: 2.20 time: 0.045524 Sep 24 15:06:55.961547 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 456/921] 10.222.0.61 () {60 vars in 1259 bytes} [Sat Sep 24 15:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-319960541 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 15:06:56.301739 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a188266a-dbbf-498b-a46f-b93b5ac762a7 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Action: 'create', calling method: .version_select at 0x7f7c143c4670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2128561527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJu6JkBCogfSfDgBji8kYK/sCD/lWiLqc1wBIwT8ueymRTVMSseX13bpQ5g+C5kkQ5grvyEPxpFFhG+DwSP23QfPwPHSkhsggBBrkVWpiFvg/7TUHZMM/jPVWDP574Yp0A=="}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:06:56.331999 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-a188266a-dbbf-498b-a46f-b93b5ac762a7 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Getting quotas for project cd72399e0d4f4e25b992e8e8cf836c18. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:06:56.336213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-a188266a-dbbf-498b-a46f-b93b5ac762a7 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Getting quotas for user 5a93a2d9266541e7bff502ba074fef5c and project cd72399e0d4f4e25b992e8e8cf836c18. Resources: {'key_pairs'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:06:56.363026 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a188266a-dbbf-498b-a46f-b93b5ac762a7 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.321571 Sep 24 15:06:56.364211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 466/922] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:06:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:06:57.951510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:57.953519 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:57.983868 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:57.984535 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:57.985076 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:57.986692 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:57.989155 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:57.992591 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:57.997982 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:58.040810 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] HTTP exception thrown: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Request method failure captured: Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 HTTP/1.1 Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxtzwCvVwOnNOWLZxYO9KOp0CZ6HLnItxmEaFGvNQAkwpiP1M5KLatXw_G_kfbZHvvxOCLz-uuO6XNNOCE_CNeZ0Lnh_e4TCLH6WHgjIQoKZQeCpHZAJgWaCCFz6yaPT9DMawDERIXBp--9G50u27PcXej1U1I9khxeYA6JvVImt7qI Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:06:58.043030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea560f6e50034738b03e588ada15e940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea560f6e50034738b03e588ada15e940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}] Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: cdbc898ffd4f4d5d87c3684fcc17313d Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.044668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': 'a4f0888f-6da8-42cb-826c-506383e4bd08'} Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:58.045557 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.047087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.049576 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Returning 404 to user: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:58.050674 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dc3fea53-e93d-422d-b54d-2d68aea695cd tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 404 len: 111 microversion: 2.20 time: 0.110503 Sep 24 15:06:58.051399 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 457/923] 10.222.0.61 () {60 vars in 1280 bytes} [Sat Sep 24 15:06:57 2022] DELETE /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 15:06:58.062531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:58.063873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: a4f0888f-6da8-42cb-826c-506383e4bd08] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:58.075881 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:58.077460 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:58.078116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:58.078832 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:58.079292 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:58.079916 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:58.108042 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] HTTP exception thrown: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Request method failure captured: Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 HTTP/1.1 Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtzwCvVwOnNOWLZxYO9KOp0CZ6HLnItxmEaFGvNQAkwpiP1M5KLatXw_G_kfbZHvvxOCLz-uuO6XNNOCE_CNeZ0Lnh_e4TCLH6WHgjIQoKZQeCpHZAJgWaCCFz6yaPT9DMawDERIXBp--9G50u27PcXej1U1I9khxeYA6JvVImt7qI Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:06:58.109783 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea560f6e50034738b03e588ada15e940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea560f6e50034738b03e588ada15e940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}] Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: cdbc898ffd4f4d5d87c3684fcc17313d Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.111505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'a4f0888f-6da8-42cb-826c-506383e4bd08'} Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:58.112531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. Sep 24 15:06:58.114010 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:58.115540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Returning 404 to user: Instance a4f0888f-6da8-42cb-826c-506383e4bd08 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:58.115540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ec132496-6916-47ed-8016-359334a244f3 tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08" status: 404 len: 111 microversion: 2.20 time: 0.057424 Sep 24 15:06:58.119516 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 467/924] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:58 2022] GET /compute/v2.1/servers/a4f0888f-6da8-42cb-826c-506383e4bd08 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 15:06:59.362280 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:59.362280 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:59.371766 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:59.372334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:59.372785 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:59.374229 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:59.374885 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:59.375316 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:59.390056 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] HTTP exception thrown: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Request method failure captured: Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 HTTP/1.1 Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxtzwCvVwOnNOWLZxYO9KOp0CZ6HLnItxmEaFGvNQAkwpiP1M5KLatXw_G_kfbZHvvxOCLz-uuO6XNNOCE_CNeZ0Lnh_e4TCLH6WHgjIQoKZQeCpHZAJgWaCCFz6yaPT9DMawDERIXBp--9G50u27PcXej1U1I9khxeYA6JvVImt7qI Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:06:59.391621 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea560f6e50034738b03e588ada15e940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea560f6e50034738b03e588ada15e940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}] Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: cdbc898ffd4f4d5d87c3684fcc17313d Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.393281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '0b247c5c-f642-4bcf-9c60-4b993f241a74'} Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:59.394203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.395740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.397308 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Returning 404 to user: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:59.397308 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-30f06b92-d29c-4a5d-bf77-6b5e279d4a4a tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 404 len: 111 microversion: 2.20 time: 0.040310 Sep 24 15:06:59.397308 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 458/925] 10.222.0.61 () {60 vars in 1280 bytes} [Sat Sep 24 15:06:59 2022] DELETE /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 24 15:06:59.401992 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:06:59.405127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] [instance: 0b247c5c-f642-4bcf-9c60-4b993f241a74] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:06:59.409376 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:59.409870 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:59.410454 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:59.411383 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:06:59.411852 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:06:59.412282 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:06:59.416277 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:06:59.432252 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] HTTP exception thrown: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Request method failure captured: Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 HTTP/1.1 Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLxtzwCvVwOnNOWLZxYO9KOp0CZ6HLnItxmEaFGvNQAkwpiP1M5KLatXw_G_kfbZHvvxOCLz-uuO6XNNOCE_CNeZ0Lnh_e4TCLH6WHgjIQoKZQeCpHZAJgWaCCFz6yaPT9DMawDERIXBp--9G50u27PcXej1U1I9khxeYA6JvVImt7qI Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:06:59.434189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea560f6e50034738b03e588ada15e940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea560f6e50034738b03e588ada15e940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea560f6e50034738b03e588ada15e940"}]}] Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: ea560f6e50034738b03e588ada15e940 Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1996674371 Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: cdbc898ffd4f4d5d87c3684fcc17313d Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1996674371-project Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.435948 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '0b247c5c-f642-4bcf-9c60-4b993f241a74'} Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:06:59.437360 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. Sep 24 15:06:59.438851 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:06:59.440164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] Returning 404 to user: Instance 0b247c5c-f642-4bcf-9c60-4b993f241a74 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:06:59.440164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bd12dd53-6dee-4438-bb23-025e4a0d3c6d tempest-AttachVolumeShelveTestJSON-1996674371 tempest-AttachVolumeShelveTestJSON-1996674371-project] 10.222.0.61 "GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74" status: 404 len: 111 microversion: 2.20 time: 0.037687 Sep 24 15:06:59.440164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 468/926] 10.222.0.61 () {60 vars in 1277 bytes} [Sat Sep 24 15:06:59 2022] GET /compute/v2.1/servers/0b247c5c-f642-4bcf-9c60-4b993f241a74 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 15:07:08.865094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e31b3ef1-43d6-408e-87cf-96e40f6997c0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'create', calling method: .version_select at 0x7f7c10b4eaf0>, body: {"keypair": {"name": "tempest-keypair-1118495739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhh5fs4P0uNOAbANsG8YWx++xRVJyxtZnW+HBvbibYlJ83XaStYbvN0v+kSHafzbv1CE6G9uKqM4MmShdgRXMmQNHLw9yCk+UMphoqRSq5YHzHyaxEKCeWU5p2RQD7vBA=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:08.881003 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-e31b3ef1-43d6-408e-87cf-96e40f6997c0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Getting quotas for project a860b6979be5483dba888a37634d196b. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:07:08.885166 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-e31b3ef1-43d6-408e-87cf-96e40f6997c0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Getting quotas for user 5d10a2be3765418cb72eeb6b15db5142 and project a860b6979be5483dba888a37634d196b. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:07:08.909417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e31b3ef1-43d6-408e-87cf-96e40f6997c0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185979 Sep 24 15:07:08.910139 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 459/927] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:07:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:07:10.426246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-7799976", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a69607cb-498b-4bf9-9145-fd54341c6030"}], "security_groups": [{"name": "tempest-securitygroup--1692633259"}], "key_name": "tempest-keypair-1118495739", "user_data": "}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:10.436321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=4 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:10.437005 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:10.551996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] validate_networks() for [('a69607cb-498b-4bf9-9145-fd54341c6030', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:07:10.985599 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:07:10.986063 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:07:10.986540 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:07:10.987146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:07:10.987636 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:07:10.997027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:10.997522 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:10.997996 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:10.999297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:10.999967 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:11.000404 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:11.017347 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Getting quotas for project a860b6979be5483dba888a37634d196b. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:07:11.021331 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Getting quotas for user 5d10a2be3765418cb72eeb6b15db5142 and project a860b6979be5483dba888a37634d196b. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:07:11.033065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:07:11.035448 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:07:11.088697 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4444bcd9-fdb2-4acd-8166-4e836282181b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666475 Sep 24 15:07:11.096899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 469/928] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:07:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:07:11.098545 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:11.103193 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-144607bb-f465-463c-ab2a-ffc330823121 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:11.103822 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-144607bb-f465-463c-ab2a-ffc330823121 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:11.173958 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-144607bb-f465-463c-ab2a-ffc330823121 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:11.181386 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-144607bb-f465-463c-ab2a-ffc330823121 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1235 microversion: 2.1 time: 0.083602 Sep 24 15:07:11.182523 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 460/929] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:11 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:12.220564 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:12.221494 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:12.235273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:12.235979 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:12.236587 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:12.237457 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:12.238280 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:12.238873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:12.334723 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:12.344346 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-398bfea2-c8b5-42a9-9156-4a818a50c395 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1287 microversion: 2.1 time: 0.128048 Sep 24 15:07:12.345215 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 470/930] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:12 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:07:13.368965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:13.370090 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:13.377668 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:13.378401 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:13.379189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:13.386203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:13.387099 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:13.387716 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:13.552972 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:13.562168 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fb005e12-cb65-4cef-83b5-103c105ff690 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1361 microversion: 2.1 time: 0.198247 Sep 24 15:07:13.562832 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 461/931] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:13 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:14.160283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-26115b1b-15c1-4135-af8b-020d06e99c70 req-5c3f29dc-beb6-4912-9b53-72c04cc7367c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8c8f87-40c5-41e2-9606-068157651b71", "tag": "63be67c4-6966-4c64-9a99-fa23e11f7821"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:14.170588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-26115b1b-15c1-4135-af8b-020d06e99c70 req-5c3f29dc-beb6-4912-9b53-72c04cc7367c service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:14.171078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-26115b1b-15c1-4135-af8b-020d06e99c70 req-5c3f29dc-beb6-4912-9b53-72c04cc7367c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:14.171505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-26115b1b-15c1-4135-af8b-020d06e99c70 req-5c3f29dc-beb6-4912-9b53-72c04cc7367c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:14.184164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-26115b1b-15c1-4135-af8b-020d06e99c70 req-5c3f29dc-beb6-4912-9b53-72c04cc7367c service nova] Creating event network-changed:63be67c4-6966-4c64-9a99-fa23e11f7821 for instance 0c8c8f87-40c5-41e2-9606-068157651b71 on hv-cinder-85919 Sep 24 15:07:14.189946 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-26115b1b-15c1-4135-af8b-020d06e99c70 req-5c3f29dc-beb6-4912-9b53-72c04cc7367c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033380 Sep 24 15:07:14.190555 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 471/932] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:07:14.543311 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-583045118", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2128561527", "security_groups": [{"name": "tempest-secgroup-smoke-2056141905"}], "block_device_mapping_v2": [{"uuid": "a74c4edc-4d1c-4219-9860-93a5a15423a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8b98b34-a708-4aa1-8351-cc592752fa2b"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:14.586289 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:14.587312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:14.593998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:14.595121 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:14.595578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:14.596294 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:14.596758 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:14.597278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:14.673642 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] validate_networks() for [('a8b98b34-a708-4aa1-8351-cc592752fa2b', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:07:14.751490 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:14.761571 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a72f8c4b-fe43-4c8b-b9f7-d9fe1c6e5103 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1361 microversion: 2.1 time: 0.180456 Sep 24 15:07:14.762095 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 472/933] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:14 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:15.376516 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:07:15.377247 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:07:15.377731 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:07:15.378245 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:07:15.378753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:07:15.387595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:15.388089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:15.388529 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:15.389845 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:15.390335 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:15.390767 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:15.407719 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Getting quotas for project cd72399e0d4f4e25b992e8e8cf836c18. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:07:15.411793 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Getting quotas for user 5a93a2d9266541e7bff502ba074fef5c and project cd72399e0d4f4e25b992e8e8cf836c18. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:07:15.493081 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:07:15.494939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a74c4edc-4d1c-4219-9860-93a5a15423a2',volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:07:15.640928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-60391aa3-672b-4aeb-932c-4f32193bf245 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.101426 Sep 24 15:07:15.641574 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 462/934] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:07:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:07:15.654427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-cf86ef8a-9525-4b50-9718-749655d0ef85 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:15.655922 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-cf86ef8a-9525-4b50-9718-749655d0ef85 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:15.729755 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-cf86ef8a-9525-4b50-9718-749655d0ef85 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:15.744843 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-cf86ef8a-9525-4b50-9718-749655d0ef85 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1094 microversion: 2.1 time: 0.095396 Sep 24 15:07:15.745614 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 473/935] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:15 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:07:15.785524 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:15.786566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:15.793784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:15.794398 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:15.794926 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:15.796283 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:15.796820 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:15.798100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:15.962522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:15.971440 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-12d45135-9232-4b87-a918-0db2cf31107b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1361 microversion: 2.1 time: 0.190105 Sep 24 15:07:15.972133 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 463/936] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:15 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:16.767502 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:16.768117 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:16.774739 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:16.775236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:16.775828 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:16.776523 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:16.776986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:16.777418 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:16.841057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:16.849028 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7b4e1104-c5b0-4f15-a148-788e7f3df231 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1192 microversion: 2.1 time: 0.085525 Sep 24 15:07:16.849616 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 474/937] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:16 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:16.995885 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:16.996501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:17.003417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:17.003910 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:17.004351 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:17.005053 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:17.005505 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:17.006146 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:17.143422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:17.151360 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-605edc46-811f-4e2c-9ca7-11dff38d5ced tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1361 microversion: 2.1 time: 0.160280 Sep 24 15:07:17.151937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 464/938] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:16 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:07:17.873510 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:17.875757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:17.882266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:17.883062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:17.883580 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:17.884402 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:17.884937 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:17.885441 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:18.097107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:18.106777 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3ab52f97-af1e-4741-821f-5a2f850d28e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.238136 Sep 24 15:07:18.108273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 475/939] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:17 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:18.177320 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:18.184034 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:18.190777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:18.191654 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:18.192106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:18.192829 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:18.193299 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:18.193728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:18.325277 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:18.334503 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-72f0662a-f3aa-464a-a15c-e5b5ade7de82 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1361 microversion: 2.1 time: 0.164470 Sep 24 15:07:18.335089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 465/940] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:18 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:18.402201 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-cc46cacb-476e-4fbe-b6fc-7b6e419422a1 req-f60200ce-79d0-449c-8938-eeaac017f8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3ca454-06df-4300-8b9a-d516ac3b5773", "tag": "bfd46edf-84b4-47fd-a2d6-5fca593348cd"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:18.416390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-cc46cacb-476e-4fbe-b6fc-7b6e419422a1 req-f60200ce-79d0-449c-8938-eeaac017f8c6 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:18.417352 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-cc46cacb-476e-4fbe-b6fc-7b6e419422a1 req-f60200ce-79d0-449c-8938-eeaac017f8c6 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:18.417798 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-cc46cacb-476e-4fbe-b6fc-7b6e419422a1 req-f60200ce-79d0-449c-8938-eeaac017f8c6 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:18.433057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-cc46cacb-476e-4fbe-b6fc-7b6e419422a1 req-f60200ce-79d0-449c-8938-eeaac017f8c6 service nova] Creating event network-changed:bfd46edf-84b4-47fd-a2d6-5fca593348cd for instance ed3ca454-06df-4300-8b9a-d516ac3b5773 on hv-cinder-85919 Sep 24 15:07:18.442402 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-cc46cacb-476e-4fbe-b6fc-7b6e419422a1 req-f60200ce-79d0-449c-8938-eeaac017f8c6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043825 Sep 24 15:07:18.443034 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 476/941] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:07:19.131278 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:19.131887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:19.133793 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:19.140014 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:19.140510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:19.140949 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:19.141646 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:19.142131 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:19.142635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:19.278975 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:19.287468 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a55cffe2-8ba0-4dab-8b45-6f5f722fc295 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.160323 Sep 24 15:07:19.288073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 466/942] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:19 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:19.371265 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:19.375236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:19.388695 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:19.389208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:19.389652 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:19.390761 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:19.390884 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:19.391285 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:19.868126 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:19.875878 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-5d5ac5c6-c607-41b9-b8e8-e575fe39f996 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1361 microversion: 2.1 time: 0.521338 Sep 24 15:07:19.876460 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 477/943] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:19 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:20.309731 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:20.311108 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:20.318001 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:20.318432 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:20.318882 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:20.319619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:20.320079 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:20.320536 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:20.452485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:20.460218 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-52758f7e-bfa0-4138-9718-c943d5db34b5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.154446 Sep 24 15:07:20.460790 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 467/944] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:20 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:20.899546 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:20.900160 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:20.907338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:20.907826 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:20.908451 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:20.909143 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:20.909600 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:20.910128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:20.936411 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-a1f0d19b-c97c-4a73-848d-b5b8f63f18be req-5c555a87-69e2-4c35-8323-83ccb1ebaff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8c8f87-40c5-41e2-9606-068157651b71", "name": "network-vif-plugged", "status": "completed", "tag": "63be67c4-6966-4c64-9a99-fa23e11f7821"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:20.949948 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-a1f0d19b-c97c-4a73-848d-b5b8f63f18be req-5c555a87-69e2-4c35-8323-83ccb1ebaff1 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:20.950829 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-a1f0d19b-c97c-4a73-848d-b5b8f63f18be req-5c555a87-69e2-4c35-8323-83ccb1ebaff1 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:20.951275 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-a1f0d19b-c97c-4a73-848d-b5b8f63f18be req-5c555a87-69e2-4c35-8323-83ccb1ebaff1 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:20.965955 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-a1f0d19b-c97c-4a73-848d-b5b8f63f18be req-5c555a87-69e2-4c35-8323-83ccb1ebaff1 service nova] Creating event network-vif-plugged:63be67c4-6966-4c64-9a99-fa23e11f7821 for instance 0c8c8f87-40c5-41e2-9606-068157651b71 on hv-cinder-85919 Sep 24 15:07:20.971586 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-a1f0d19b-c97c-4a73-848d-b5b8f63f18be req-5c555a87-69e2-4c35-8323-83ccb1ebaff1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041166 Sep 24 15:07:20.972476 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 468/945] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:07:21.007838 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:21.068769 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:21.075128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-66555ddc-9cda-458b-9d2e-bc32637ae889 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1361 microversion: 2.1 time: 0.179294 Sep 24 15:07:21.082437 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 478/946] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:20 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:21.483665 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:21.484373 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:21.490859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:21.491361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:21.492065 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:21.492772 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:21.493243 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:21.493682 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:21.634413 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:21.642231 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-94bf6c60-b09f-49cc-a998-21cc40643436 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.163877 Sep 24 15:07:21.642807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 469/947] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:21 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:22.098965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:22.099580 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:22.106312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:22.106808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:22.107251 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:22.107986 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:22.108444 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:22.108873 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:22.239904 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:22.247648 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e36f6fd2-606b-46ff-bae2-5eb5212a648b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1361 microversion: 2.1 time: 0.152520 Sep 24 15:07:22.248845 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 479/948] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:22 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:22.665230 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:22.665841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:22.672800 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:22.673287 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:22.673734 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:22.674452 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:22.674912 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:22.675338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:22.816709 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:22.824423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-afcee7b2-2e1a-44af-991e-252a76c47f0c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.163153 Sep 24 15:07:22.824982 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 470/949] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:22 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:23.274178 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:23.274786 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:23.281703 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:23.282159 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:23.282598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:23.283291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:23.283745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:23.284170 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:23.411584 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:23.419237 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c0a62e2f-fbdc-4a16-8730-b3d352db120f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1547 microversion: 2.1 time: 0.148835 Sep 24 15:07:23.420483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 480/950] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:23 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:23.442546 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-55670677-a316-4315-bcb2-52f65c181370 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:23.442762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-55670677-a316-4315-bcb2-52f65c181370 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:23.448647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55670677-a316-4315-bcb2-52f65c181370 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:23.449148 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55670677-a316-4315-bcb2-52f65c181370 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:23.449595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55670677-a316-4315-bcb2-52f65c181370 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:23.450335 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55670677-a316-4315-bcb2-52f65c181370 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:23.450803 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55670677-a316-4315-bcb2-52f65c181370 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:23.451244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-55670677-a316-4315-bcb2-52f65c181370 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:23.526391 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-55670677-a316-4315-bcb2-52f65c181370 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087927 Sep 24 15:07:23.527004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 471/951] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Sep 24 15:07:23 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:07:23.846260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:23.846877 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:23.852852 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:23.853376 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:23.853867 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:23.854598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:23.855055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:23.855483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:23.989443 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:23.997438 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ccb5b510-b7a9-42be-8795-8ecf89ac7c83 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.155550 Sep 24 15:07:23.998066 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 481/952] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:23 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:24.465443 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-d17e67df-1c51-45d3-b7bd-3998f66c14a1 req-3097b5a3-2a24-41dd-8f01-030607dced31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8c8f87-40c5-41e2-9606-068157651b71", "tag": "63be67c4-6966-4c64-9a99-fa23e11f7821"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:24.475403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-d17e67df-1c51-45d3-b7bd-3998f66c14a1 req-3097b5a3-2a24-41dd-8f01-030607dced31 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:24.475890 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-d17e67df-1c51-45d3-b7bd-3998f66c14a1 req-3097b5a3-2a24-41dd-8f01-030607dced31 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:24.476332 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-d17e67df-1c51-45d3-b7bd-3998f66c14a1 req-3097b5a3-2a24-41dd-8f01-030607dced31 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:24.487423 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-d17e67df-1c51-45d3-b7bd-3998f66c14a1 req-3097b5a3-2a24-41dd-8f01-030607dced31 service nova] Creating event network-changed:63be67c4-6966-4c64-9a99-fa23e11f7821 for instance 0c8c8f87-40c5-41e2-9606-068157651b71 on hv-cinder-85919 Sep 24 15:07:24.492530 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-d17e67df-1c51-45d3-b7bd-3998f66c14a1 req-3097b5a3-2a24-41dd-8f01-030607dced31 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031086 Sep 24 15:07:24.493124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 472/953] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:07:25.020892 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:25.021510 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:25.028353 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:25.029130 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:25.030167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:25.030876 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:25.031340 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:25.031775 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:25.232804 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:25.240552 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0229358a-7f79-4b60-aef7-f93e6e9a3bf3 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.223496 Sep 24 15:07:25.241632 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 482/954] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:25 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:26.262516 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:26.263295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=12 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:26.268080 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:26.268823 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:26.275857 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:26.276353 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:26.276804 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:26.277507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:26.278014 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:26.278454 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:26.416896 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:26.425105 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0858b3ed-0113-4f69-b39d-863332ed339a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.163603 Sep 24 15:07:26.425670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 473/955] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:26 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:27.448297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:27.448911 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:27.452505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=8 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:27.457186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:27.458143 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:27.459002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:27.459721 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:27.460249 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:27.460696 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:27.593785 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:27.601367 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-436b3f73-ba72-447f-87c4-c0f1a1fdf23d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.157112 Sep 24 15:07:27.601950 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 483/956] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:27 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:28.624052 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:28.624665 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:28.631038 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:28.631527 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:28.631969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:28.632656 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:28.633116 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:28.633538 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:28.772293 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:28.781310 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-68e4c7a9-56f2-4b1b-8c63-a5c6f8f1d952 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.161241 Sep 24 15:07:28.781884 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 474/957] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:28 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:28.985855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-00b6c476-d29a-446f-9ea3-1778d7894a58 req-3582dd8e-e0d1-473e-a1e2-a9f5142530f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3ca454-06df-4300-8b9a-d516ac3b5773", "name": "network-vif-plugged", "status": "completed", "tag": "bfd46edf-84b4-47fd-a2d6-5fca593348cd"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:28.996228 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-00b6c476-d29a-446f-9ea3-1778d7894a58 req-3582dd8e-e0d1-473e-a1e2-a9f5142530f7 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:28.996710 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-00b6c476-d29a-446f-9ea3-1778d7894a58 req-3582dd8e-e0d1-473e-a1e2-a9f5142530f7 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:28.997142 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-00b6c476-d29a-446f-9ea3-1778d7894a58 req-3582dd8e-e0d1-473e-a1e2-a9f5142530f7 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:29.008627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-00b6c476-d29a-446f-9ea3-1778d7894a58 req-3582dd8e-e0d1-473e-a1e2-a9f5142530f7 service nova] Creating event network-vif-plugged:bfd46edf-84b4-47fd-a2d6-5fca593348cd for instance ed3ca454-06df-4300-8b9a-d516ac3b5773 on hv-cinder-85919 Sep 24 15:07:29.014370 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-00b6c476-d29a-446f-9ea3-1778d7894a58 req-3582dd8e-e0d1-473e-a1e2-a9f5142530f7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031466 Sep 24 15:07:29.015197 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 484/958] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:07:29.804017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:29.804623 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:29.811062 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:29.811550 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:29.811990 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:29.812681 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:29.813136 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:29.813566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:29.944078 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:29.951801 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d5457a54-f947-4451-a2b9-aa10a05839f5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1266 microversion: 2.1 time: 0.151623 Sep 24 15:07:29.952380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 475/959] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:29 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:30.975393 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:30.976095 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:30.983024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:30.983856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:30.984640 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:30.986072 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:30.986785 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:30.987500 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:31.130101 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:31.139073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3e4b537f-310c-4fcb-b782-5c104c5b5702 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1452 microversion: 2.1 time: 0.167382 Sep 24 15:07:31.139758 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 485/960] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:30 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:31.162326 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:31.162953 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:31.170089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:31.170595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:31.171049 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:31.171762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:31.172330 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:31.172779 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:31.306360 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:31.314295 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b6943205-6495-4b57-81bb-8629fedd8b1f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1452 microversion: 2.1 time: 0.156489 Sep 24 15:07:31.314873 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 476/961] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:31 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:33.256983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-c062443e-f67f-4037-8ad3-aa2062c450cd req-25c8fcd2-28a5-4278-b3c9-97339b8bac96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3ca454-06df-4300-8b9a-d516ac3b5773", "tag": "bfd46edf-84b4-47fd-a2d6-5fca593348cd"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:33.267068 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-c062443e-f67f-4037-8ad3-aa2062c450cd req-25c8fcd2-28a5-4278-b3c9-97339b8bac96 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:33.267563 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-c062443e-f67f-4037-8ad3-aa2062c450cd req-25c8fcd2-28a5-4278-b3c9-97339b8bac96 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:33.268002 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-c062443e-f67f-4037-8ad3-aa2062c450cd req-25c8fcd2-28a5-4278-b3c9-97339b8bac96 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:33.278642 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-c062443e-f67f-4037-8ad3-aa2062c450cd req-25c8fcd2-28a5-4278-b3c9-97339b8bac96 service nova] Creating event network-changed:bfd46edf-84b4-47fd-a2d6-5fca593348cd for instance ed3ca454-06df-4300-8b9a-d516ac3b5773 on hv-cinder-85919 Sep 24 15:07:33.283430 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-c062443e-f67f-4037-8ad3-aa2062c450cd req-25c8fcd2-28a5-4278-b3c9-97339b8bac96 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030865 Sep 24 15:07:33.284241 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 486/962] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:07:50.772866 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:50.773612 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:50.775980 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=21 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:50.776310 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-607a35de-464b-4563-bfc0-80be8e7b7e8f req-f8b5a7cb-3cd6-4d40-9395-16445b0501bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775dbe6e-e603-4a12-84b4-3bae6637954d", "tag": "10e26e89-d2cf-44a3-8d75-3fdc714831ff"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:50.777277 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=82 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:50.782279 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:50.783704 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=83 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:07:50.783850 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:50.784371 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:50.784933 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:50.785791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:50.786379 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:50.787053 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:50.793615 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-607a35de-464b-4563-bfc0-80be8e7b7e8f req-f8b5a7cb-3cd6-4d40-9395-16445b0501bb service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:50.794273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-607a35de-464b-4563-bfc0-80be8e7b7e8f req-f8b5a7cb-3cd6-4d40-9395-16445b0501bb service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:50.794715 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-607a35de-464b-4563-bfc0-80be8e7b7e8f req-f8b5a7cb-3cd6-4d40-9395-16445b0501bb service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:50.807211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-607a35de-464b-4563-bfc0-80be8e7b7e8f req-f8b5a7cb-3cd6-4d40-9395-16445b0501bb service nova] Creating event network-changed:10e26e89-d2cf-44a3-8d75-3fdc714831ff for instance 775dbe6e-e603-4a12-84b4-3bae6637954d on hv-cinder-85919 Sep 24 15:07:50.812523 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-607a35de-464b-4563-bfc0-80be8e7b7e8f req-f8b5a7cb-3cd6-4d40-9395-16445b0501bb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040679 Sep 24 15:07:50.813269 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 487/963] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:07:50.814748 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:07:50.904034 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5fa55613-8f30-4022-aea7-ea8443690f46 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "DELETE /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 204 len: 0 microversion: 2.1 time: 0.134780 Sep 24 15:07:50.908126 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 477/964] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:07:50 2022] DELETE /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 15:07:50.914598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:50.915297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:50.922438 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:50.923200 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:50.923823 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:50.924698 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:50.925329 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:50.925757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:51.060764 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:51.069168 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0c1cfb44-484e-4b86-88f6-f300a4afe51d tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.159405 Sep 24 15:07:51.069742 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 488/965] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:50 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:07:52.095002 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:52.095640 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:52.102104 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:52.102600 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:52.103044 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:52.103809 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:52.104392 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:52.104831 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:52.242474 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:52.250649 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6d51e19a-a764-4ca1-893b-1025b91595ae tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1569 microversion: 2.1 time: 0.160947 Sep 24 15:07:52.251223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 478/966] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:52 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:53.280588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:53.282389 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:53.288859 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:53.289781 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:53.290471 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:53.291364 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:53.292237 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:53.292843 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:53.552819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:53.560486 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0dece2ce-f889-4b74-afcf-afb4498e6158 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1451 microversion: 2.1 time: 0.284970 Sep 24 15:07:53.561065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 489/967] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:53 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1451 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:07:53.858588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-42f597d2-bfdd-4337-8f48-4f2fb31c82e3 req-8b3165fc-ab71-4d40-8644-4bf0f0774a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775dbe6e-e603-4a12-84b4-3bae6637954d", "name": "network-vif-deleted", "tag": "10e26e89-d2cf-44a3-8d75-3fdc714831ff"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:07:53.869496 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-42f597d2-bfdd-4337-8f48-4f2fb31c82e3 req-8b3165fc-ab71-4d40-8644-4bf0f0774a0d service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:53.870106 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-42f597d2-bfdd-4337-8f48-4f2fb31c82e3 req-8b3165fc-ab71-4d40-8644-4bf0f0774a0d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:53.870613 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-42f597d2-bfdd-4337-8f48-4f2fb31c82e3 req-8b3165fc-ab71-4d40-8644-4bf0f0774a0d service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:53.884566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-42f597d2-bfdd-4337-8f48-4f2fb31c82e3 req-8b3165fc-ab71-4d40-8644-4bf0f0774a0d service nova] Creating event network-vif-deleted:10e26e89-d2cf-44a3-8d75-3fdc714831ff for instance 775dbe6e-e603-4a12-84b4-3bae6637954d on hv-cinder-85919 Sep 24 15:07:53.890885 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-42f597d2-bfdd-4337-8f48-4f2fb31c82e3 req-8b3165fc-ab71-4d40-8644-4bf0f0774a0d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036893 Sep 24 15:07:53.891647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 479/968] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:07:54.585511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:54.585511 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:54.591230 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:54.591737 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:54.592184 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:54.593444 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:54.594278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:54.594897 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:54.627757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:54.628246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:54.628695 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:54.629145 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lazy-loading 'fault' on Instance uuid 775dbe6e-e603-4a12-84b4-3bae6637954d {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:07:54.680024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8a3f8bef9f0431eac090f8a520f744b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43e1ec63be6740fa9516a2e5331986a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:07:54.687912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8a7ef8d4-0cc4-4022-b520-4c1122c2f00c tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 200 len: 1225 microversion: 2.1 time: 0.108158 Sep 24 15:07:54.688489 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 490/969] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:54 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:07:55.712114 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:55.712832 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] [instance: 775dbe6e-e603-4a12-84b4-3bae6637954d] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:07:55.719617 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:55.720113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:55.720608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:55.721305 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:07:55.722204 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:07:55.722651 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:07:55.736488 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] HTTP exception thrown: Instance 775dbe6e-e603-4a12-84b4-3bae6637954d could not be found. Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Request method failure captured: Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d HTTP/1.1 Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLxwViIlhODuweShkWiNXQqajkHVtGRj7eksGdcdhlMiIDDkHbef0NE4ESBpMb-qCGlVcMiKxwrivx5b-SLWy_l7Klvdf3OH6_KGMZVtX6OCVpANMek4GJ39oML3DqYvXjLoxXJVucXGxfqfuKiq_9Y9z717Z9yXlZCrrI0_3fARQVP8 Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: 43e1ec63be6740fa9516a2e5331986a2 Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-TestShelveInstance-464112666 Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:07:55.738456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_43e1ec63be6740fa9516a2e5331986a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/43e1ec63be6740fa9516a2e5331986a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/43e1ec63be6740fa9516a2e5331986a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/43e1ec63be6740fa9516a2e5331986a2"}]}] Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-TestShelveInstance-464112666 Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: 43e1ec63be6740fa9516a2e5331986a2 Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-TestShelveInstance-464112666 Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-TestShelveInstance-464112666-project Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: c8a3f8bef9f0431eac090f8a520f744b Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-TestShelveInstance-464112666-project Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 775dbe6e-e603-4a12-84b4-3bae6637954d could not be found. Sep 24 15:07:55.740548 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '775dbe6e-e603-4a12-84b4-3bae6637954d'} Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775dbe6e-e603-4a12-84b4-3bae6637954d could not be found. Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:07:55.741762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775dbe6e-e603-4a12-84b4-3bae6637954d could not be found. Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775dbe6e-e603-4a12-84b4-3bae6637954d could not be found. Sep 24 15:07:55.744263 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:07:55.746640 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Returning 404 to user: Instance 775dbe6e-e603-4a12-84b4-3bae6637954d could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:07:55.746640 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0a1a76ea-4097-4edc-acf7-e8649dbf0063 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d" status: 404 len: 111 microversion: 2.1 time: 0.032546 Sep 24 15:07:55.746640 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 480/970] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:07:55 2022] GET /compute/v2.1/servers/775dbe6e-e603-4a12-84b4-3bae6637954d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:07:55.919025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a1b3a404-6d45-4181-a849-50e7c2fd09d3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] Calling method '.version_select at 0x7f7c10b30820>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:07:55.941936 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a1b3a404-6d45-4181-a849-50e7c2fd09d3 tempest-TestShelveInstance-464112666 tempest-TestShelveInstance-464112666-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1433808875" status: 202 len: 0 microversion: 2.1 time: 0.026626 Sep 24 15:07:55.942652 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 491/971] 10.222.0.61 () {58 vars in 1254 bytes} [Sat Sep 24 15:07:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1433808875 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:08:08.055909 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cc8463f4-85ac-4ef2-b181-0246553b55fa tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:08.056511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cc8463f4-85ac-4ef2-b181-0246553b55fa tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:08.060274 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:08:08.061123 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:08:08.065428 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc8463f4-85ac-4ef2-b181-0246553b55fa tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:08.065954 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc8463f4-85ac-4ef2-b181-0246553b55fa tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:08.066412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc8463f4-85ac-4ef2-b181-0246553b55fa tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:08.067189 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc8463f4-85ac-4ef2-b181-0246553b55fa tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:08.067670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc8463f4-85ac-4ef2-b181-0246553b55fa tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:08.068109 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc8463f4-85ac-4ef2-b181-0246553b55fa tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:08.096104 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cc8463f4-85ac-4ef2-b181-0246553b55fa tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/ips" status: 200 len: 145 microversion: 2.1 time: 0.043986 Sep 24 15:08:08.096691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 481/972] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 15:08:08 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:08:11.865015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=22 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:08:11.865768 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:08:11.870223 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-aa26e788-8329-4d63-bf42-a011151ad1c4 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39044012-335a-4651-84a2-23d3d4cd79c2"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:08:11.872535 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-aa26e788-8329-4d63-bf42-a011151ad1c4 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:11.881125 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa26e788-8329-4d63-bf42-a011151ad1c4 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:11.881620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa26e788-8329-4d63-bf42-a011151ad1c4 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:11.882103 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa26e788-8329-4d63-bf42-a011151ad1c4 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:11.882814 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa26e788-8329-4d63-bf42-a011151ad1c4 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:11.883273 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa26e788-8329-4d63-bf42-a011151ad1c4 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:11.883710 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aa26e788-8329-4d63-bf42-a011151ad1c4 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:14.464307 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-aa26e788-8329-4d63-bf42-a011151ad1c4 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.600389 Sep 24 15:08:14.465590 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 492/973] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:08:11 2022] POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/os-volume_attachments => generated 194 bytes in 2603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:08:23.053585 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-557c301a-de57-4167-a19f-e7d9f931349b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:08:23.055980 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:08:23.061314 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-557c301a-de57-4167-a19f-e7d9f931349b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:23.061807 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-557c301a-de57-4167-a19f-e7d9f931349b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:23.062277 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-557c301a-de57-4167-a19f-e7d9f931349b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:23.121598 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-557c301a-de57-4167-a19f-e7d9f931349b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Going to try to stop instance {{(pid=120591) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 15:08:23.162574 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-557c301a-de57-4167-a19f-e7d9f931349b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/action" status: 202 len: 0 microversion: 2.1 time: 0.112728 Sep 24 15:08:23.163158 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 482/974] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:08:23 2022] POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:08:23.169304 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:08:23.174754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:23.175472 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:23.181936 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:23.182439 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:23.182888 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:23.183596 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:23.184065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:23.184497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:23.313035 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:23.321729 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-07097c44-4fe2-4462-a638-c2a2c284672a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.153944 Sep 24 15:08:23.322333 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 493/975] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:23 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:08:24.346441 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:24.347173 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:24.353282 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:24.353769 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:24.354234 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:24.354932 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:24.355405 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:24.355832 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:24.484088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:24.492194 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-254d10f3-efe4-4c61-b64f-76a1c33dce64 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.151080 Sep 24 15:08:24.493030 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 483/976] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:24 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:25.515261 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:25.515880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:25.522826 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:25.523325 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:25.523773 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:25.524476 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:25.524939 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:25.525373 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:25.648989 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:25.657963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-30e8a585-bce9-401f-b699-1859dd8ddc2d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.145975 Sep 24 15:08:25.658556 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 494/977] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:25 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:26.681802 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:26.682468 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:26.688874 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:26.689364 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:26.689813 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:26.690541 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:26.691011 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:26.691452 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:26.825132 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:26.833374 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f2cbe5dc-6b77-47ea-9500-b65299395620 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.155504 Sep 24 15:08:26.833971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 484/978] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:26 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:27.857068 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:27.857699 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:27.865011 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:27.865517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:27.865983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:27.866708 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:27.867171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:27.867872 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:27.996266 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:28.005006 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4b510445-9b70-4502-b00a-7f26a44aa668 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.152065 Sep 24 15:08:28.005572 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 495/979] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:27 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:29.031107 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:29.031733 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:29.038999 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:29.039496 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:29.039939 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:29.040642 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:29.041108 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:29.041545 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:29.170232 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:29.178974 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d4ef67d5-0e62-468f-bd78-56f26e4fd964 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.151765 Sep 24 15:08:29.179541 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 485/980] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:29 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:30.202405 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:30.202950 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:30.210009 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:30.210497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:30.210933 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:30.211620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:30.212075 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:30.212498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:30.346980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:30.357642 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b5543466-0461-4c61-a734-4617269aa3f8 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.159229 Sep 24 15:08:30.358261 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 496/981] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:30 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:31.380806 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:31.381482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:31.388251 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:31.388744 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:31.389186 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:31.389896 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:31.390387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:31.390821 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:31.521129 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:31.529329 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4419fcbb-6d35-4d3d-ab42-da0675ec412f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.152503 Sep 24 15:08:31.529923 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 486/982] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:31 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:32.553024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:32.553711 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:32.560350 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:32.560846 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:32.561291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:32.562019 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:32.562486 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:32.562919 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:32.688237 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:32.696343 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-96918045-0d12-4f7e-8778-7514ed70c70b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.147141 Sep 24 15:08:32.696911 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 497/983] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:32 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:33.720795 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:33.721408 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:33.727873 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:33.728358 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:33.728796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:33.729478 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:33.729973 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:33.730404 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:33.864036 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:33.872349 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9a77b8d6-3662-416d-bd34-fa7bf6d24613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.155992 Sep 24 15:08:33.872918 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 487/984] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:33 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:34.895508 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:34.896112 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:34.902518 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:34.903004 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:34.903440 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:34.904124 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:34.904579 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:34.905003 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:35.033818 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:35.042007 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-196ec1e1-6629-45c8-8d44-4e8937b9d332 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.150416 Sep 24 15:08:35.042577 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 498/985] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:34 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:36.066633 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:36.067255 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:36.073622 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:36.074150 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:36.074603 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:36.075300 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:36.075766 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:36.076201 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:36.200686 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:36.208844 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-526dbdcd-3e98-4fc4-a416-d023c9640943 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.146821 Sep 24 15:08:36.209456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 488/986] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:36 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:37.231883 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:37.232502 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:37.239049 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:37.239547 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:37.239994 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:37.240698 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:37.241162 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:37.241597 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:37.366998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:37.375317 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-01fc055c-f694-40e7-b545-d52e9a10c436 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.147413 Sep 24 15:08:37.376384 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 499/987] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:37 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:38.398854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:38.399473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:38.405764 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:38.406276 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:38.406716 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:38.407972 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:38.408432 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:38.408860 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:38.541028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:38.549508 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-0dbb9db3-e3dd-439f-ba24-d45ba5f1f56d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1721 microversion: 2.1 time: 0.154548 Sep 24 15:08:38.550210 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 489/988] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:38 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:39.573015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:39.573639 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:39.580820 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:39.581318 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:39.581768 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:39.582507 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:39.582977 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:39.583415 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:39.707024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:39.715191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-08422ace-2340-4705-9aa4-f18175196e00 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1698 microversion: 2.1 time: 0.146054 Sep 24 15:08:39.715766 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 500/989] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:39 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1698 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:39.737238 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cd0684bc-198d-4985-8c5a-5fb741dfcae0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:08:39.744032 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd0684bc-198d-4985-8c5a-5fb741dfcae0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:39.744527 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd0684bc-198d-4985-8c5a-5fb741dfcae0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:39.744969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cd0684bc-198d-4985-8c5a-5fb741dfcae0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:39.774659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cd0684bc-198d-4985-8c5a-5fb741dfcae0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Going to try to start instance {{(pid=120591) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 15:08:39.816109 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cd0684bc-198d-4985-8c5a-5fb741dfcae0 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/action" status: 202 len: 0 microversion: 2.1 time: 0.082575 Sep 24 15:08:39.816723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 490/990] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:08:39 2022] POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 15:08:39.824915 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:39.825474 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:39.831427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:39.831976 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:39.832448 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:39.833205 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:39.833714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:39.834182 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:39.995632 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:40.004253 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-46a197ff-1e8f-4e2f-9da6-507f32bf1b9f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1707 microversion: 2.1 time: 0.183312 Sep 24 15:08:40.004840 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 501/991] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:39 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1707 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:41.028818 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:41.029526 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:41.041401 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:41.041928 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:41.042391 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:41.043101 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:41.043573 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:41.044008 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:41.181160 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:41.190412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8ba39061-0e99-45fb-ad48-3e69f2537032 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1707 microversion: 2.1 time: 0.166214 Sep 24 15:08:41.190931 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 491/992] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:41 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1707 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:08:42.214196 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:08:42.214745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:08:42.221858 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:42.222386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:42.222831 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:42.223534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:08:42.224001 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:08:42.224436 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:08:42.228336 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:08:42.361131 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:08:42.369581 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e534f33f-0f67-418c-b2c0-454f052d0ee6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1711 microversion: 2.1 time: 0.159404 Sep 24 15:08:42.370183 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 502/993] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:08:42 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:15.125699 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:15.126239 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:15.129286 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=20 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:15.130181 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:15.135693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:15.136191 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:15.136638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:15.137374 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:15.137838 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:15.138300 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:15.217482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lazy-loading 'services' on Instance uuid 0c8c8f87-40c5-41e2-9606-068157651b71 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:09:15.289507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-4312bc04-d5b3-4a72-ab79-24111086af80 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/os-volume_attachments/39044012-335a-4651-84a2-23d3d4cd79c2" status: 202 len: 0 microversion: 2.1 time: 0.167653 Sep 24 15:09:15.290151 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 492/994] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:09:15 2022] DELETE /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/os-volume_attachments/39044012-335a-4651-84a2-23d3d4cd79c2 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:09:16.408703 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2ce7e7f2-219f-4071-859e-4d68a303e6ba tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:09:16.411153 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=20 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:16.411963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=5 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:16.417680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2ce7e7f2-219f-4071-859e-4d68a303e6ba tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:16.418212 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2ce7e7f2-219f-4071-859e-4d68a303e6ba tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:16.418671 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2ce7e7f2-219f-4071-859e-4d68a303e6ba tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:16.478345 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2ce7e7f2-219f-4071-859e-4d68a303e6ba tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Going to try to stop instance {{(pid=120590) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 15:09:16.522123 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2ce7e7f2-219f-4071-859e-4d68a303e6ba tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/action" status: 202 len: 0 microversion: 2.1 time: 0.117111 Sep 24 15:09:16.523087 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 503/995] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:09:16 2022] POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:09:16.532140 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:16.532849 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:16.539073 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:16.539619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:16.540011 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:16.540716 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:16.541181 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:16.541616 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:16.673801 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:16.682077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1434d12d-491a-49c1-b68d-b3e61dd8f9b6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1675 microversion: 2.1 time: 0.154590 Sep 24 15:09:16.682659 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 493/996] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:16 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:09:17.707482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:17.708184 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:17.714650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:17.715143 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:17.715584 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:17.716281 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:17.716742 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:17.717173 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:17.850586 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:17.858123 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7de39a56-86e4-42ee-89c1-e2e3f74d4f44 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1675 microversion: 2.1 time: 0.155610 Sep 24 15:09:17.858690 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 504/997] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:17 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:18.880661 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:18.881218 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:18.887553 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:18.888040 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:18.888476 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:18.889163 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:18.889616 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:18.890069 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:19.238066 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:19.245927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5fbef083-e6eb-40de-91bd-3b86ab6a80fe tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1675 microversion: 2.1 time: 0.369234 Sep 24 15:09:19.246501 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 494/998] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:18 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1675 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:09:20.269927 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:20.270543 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:20.277116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:20.277606 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:20.278078 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:20.278796 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:20.279252 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:20.279702 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:20.406139 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:20.414390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-630e710d-f3c3-4fb4-ad23-9463923c105c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1675 microversion: 2.1 time: 0.148826 Sep 24 15:09:20.414962 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 505/999] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:20 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:21.436500 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:21.437117 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:21.443513 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:21.444006 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:21.444446 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:21.445143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:21.445714 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:21.446174 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:21.572704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:21.580601 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8ef9fe11-f822-4638-b4d7-bf41b485d99f tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1675 microversion: 2.1 time: 0.147994 Sep 24 15:09:21.581209 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 495/1000] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:21 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:22.603961 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:22.604576 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:22.611024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:22.611518 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:22.612464 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:22.613167 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:22.613629 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:22.614093 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:22.744479 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:22.752066 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-7cafd182-0df6-4dd7-839f-3578a9ff218c tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1675 microversion: 2.1 time: 0.151961 Sep 24 15:09:22.753237 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 506/1001] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:22 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:23.775841 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:23.776463 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:23.782772 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:23.783265 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:23.783709 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:23.784435 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:23.784901 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:23.785330 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:23.914242 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:23.922198 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-084c075b-b31d-4dc8-bdc8-533dd66aea81 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1675 microversion: 2.1 time: 0.150212 Sep 24 15:09:23.922784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 496/1002] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:23 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:24.944661 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:24.945282 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:24.951712 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:24.952202 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:24.952646 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:24.953342 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:24.953805 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:24.954260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:25.082572 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:25.090087 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f35bfe38-8768-4fdf-a980-3d3c91f65c63 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1675 microversion: 2.1 time: 0.149322 Sep 24 15:09:25.090656 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 507/1003] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:24 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:26.113523 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:26.114177 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:26.121052 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:26.121549 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:26.122023 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:26.122730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:26.123198 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:26.123635 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:26.252433 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:26.260673 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-aeec3bb8-6b90-4738-95b7-e089eba48178 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1675 microversion: 2.1 time: 0.151625 Sep 24 15:09:26.261250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 497/1004] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:26 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:27.284632 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:27.285275 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:27.291737 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:27.292232 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:27.292678 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:27.293371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:27.293835 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:27.294296 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:27.423244 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:27.432383 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6334dfef-6af7-46ae-8897-9b24107fe221 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1652 microversion: 2.1 time: 0.151729 Sep 24 15:09:27.432940 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 508/1005] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:27 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:27.457596 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-66bda41f-1e31-48df-beb7-5beb548f94a6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:09:27.464418 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66bda41f-1e31-48df-beb7-5beb548f94a6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:27.464915 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66bda41f-1e31-48df-beb7-5beb548f94a6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:27.465357 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-66bda41f-1e31-48df-beb7-5beb548f94a6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:27.488140 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-66bda41f-1e31-48df-beb7-5beb548f94a6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Going to try to start instance {{(pid=120591) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 15:09:27.530243 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-66bda41f-1e31-48df-beb7-5beb548f94a6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/action" status: 202 len: 0 microversion: 2.1 time: 0.076552 Sep 24 15:09:27.530887 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 498/1006] 10.222.0.61 () {60 vars in 1278 bytes} [Sat Sep 24 15:09:27 2022] POST /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:09:27.539519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:27.540073 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:27.546030 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:27.546532 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:27.547037 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:27.547784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:27.548225 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:27.548657 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:27.686396 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:27.694014 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ee507b61-d6ec-4c68-82de-d12e06fd1542 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1661 microversion: 2.1 time: 0.158441 Sep 24 15:09:27.694588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 509/1007] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:27 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:09:28.718389 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:28.719095 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:28.725882 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:28.726392 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:28.726828 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:28.727517 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:28.727976 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:28.728402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:28.859810 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:28.868244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-dc440841-631a-44a0-8a21-6c83df6a8628 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1661 microversion: 2.1 time: 0.154186 Sep 24 15:09:28.869074 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 499/1008] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:28 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:29.891127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:29.891732 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:29.898697 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:29.899181 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:29.899617 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:29.900305 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:29.900766 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:29.901189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:30.028509 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:30.035999 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b008cfba-9b11-4a2a-b5f5-37fa70563ed9 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1665 microversion: 2.1 time: 0.148702 Sep 24 15:09:30.036565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 510/1009] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:29 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:35.449276 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:35.449839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:35.456160 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:35.456647 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:35.457088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:35.457779 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:35.458791 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:35.459221 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:35.483687 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:09:35.556753 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-ee747a70-9488-4d36-babd-7fb244002a46 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 204 len: 0 microversion: 2.1 time: 0.111211 Sep 24 15:09:35.557698 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 500/1010] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:09:35 2022] DELETE /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:09:35.566513 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:35.567136 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:35.574004 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:35.574497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:35.574970 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:35.575661 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:35.576120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:35.576577 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:35.707600 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:35.715780 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-541f04f1-d42f-45e4-bf46-6c02dcc91a71 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1576 microversion: 2.1 time: 0.153194 Sep 24 15:09:35.716345 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 511/1011] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:35 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:09:36.739566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:36.740281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:36.747092 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:36.747622 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:36.748094 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:36.748796 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:36.749264 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:36.749702 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:36.879742 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:36.887596 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-52f07eeb-c746-4d67-8505-1dd551f233df tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1576 microversion: 2.1 time: 0.152363 Sep 24 15:09:36.888182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 501/1012] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:36 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:37.911046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:37.911784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:37.918042 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:37.918564 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:37.919071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:37.919848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:37.920373 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:37.921483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:38.010504 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:38.018187 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-fd5292dc-7b9e-48d6-9980-1663728c4246 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1508 microversion: 2.1 time: 0.111159 Sep 24 15:09:38.021694 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 512/1013] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:37 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1508 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:38.203430 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-c79aad54-14aa-41ad-bef7-0a05cefb6303 req-990c5373-4359-4195-81df-8182b931a387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3ca454-06df-4300-8b9a-d516ac3b5773", "name": "network-vif-deleted", "tag": "bfd46edf-84b4-47fd-a2d6-5fca593348cd"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:09:38.219291 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-c79aad54-14aa-41ad-bef7-0a05cefb6303 req-990c5373-4359-4195-81df-8182b931a387 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:38.219861 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-c79aad54-14aa-41ad-bef7-0a05cefb6303 req-990c5373-4359-4195-81df-8182b931a387 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:38.220352 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-c79aad54-14aa-41ad-bef7-0a05cefb6303 req-990c5373-4359-4195-81df-8182b931a387 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:38.236105 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-c79aad54-14aa-41ad-bef7-0a05cefb6303 req-990c5373-4359-4195-81df-8182b931a387 service nova] Creating event network-vif-deleted:bfd46edf-84b4-47fd-a2d6-5fca593348cd for instance ed3ca454-06df-4300-8b9a-d516ac3b5773 on hv-cinder-85919 Sep 24 15:09:38.243176 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-c79aad54-14aa-41ad-bef7-0a05cefb6303 req-990c5373-4359-4195-81df-8182b931a387 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043403 Sep 24 15:09:38.244037 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 502/1014] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:09:39.043522 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:39.044292 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:39.050844 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:39.051345 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:39.051834 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:39.052611 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:39.053316 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:39.053694 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:39.089782 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:39.090317 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:39.090757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:39.091210 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.objects.instance [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lazy-loading 'fault' on Instance uuid ed3ca454-06df-4300-8b9a-d516ac3b5773 {{(pid=120590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:09:39.134980 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:39.143866 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-b47b32cb-36e7-4683-ac9e-5c0295a9902a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 200 len: 1230 microversion: 2.1 time: 0.104373 Sep 24 15:09:39.144455 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 513/1015] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:39 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:40.168742 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:40.169453 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:40.175603 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:40.176102 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:40.176551 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:40.177849 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:40.178340 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:40.178777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:40.191876 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] HTTP exception thrown: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Request method failure captured: Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 HTTP/1.1 Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLx0JL6gtG2eWWUHRpR8rnNWhkXcsvsP8811D3DrQhsaBWYS34v33lmdEOkd_g95CpIH67v8Or1DbdIwL2jfCfhjWsyVJQJd2dz2D5Ee_rOuen6EQHXIG0rjp_IsdEkdQhQ33_6Zjf7eh2LQ2mVOXDomVJrldK2XN1zleJ86n-2nGwWM Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:09:40.193427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}] Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-TestVolumeBootPattern-293612076 Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 5a93a2d9266541e7bff502ba074fef5c Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:09:40.195097 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': 'ed3ca454-06df-4300-8b9a-d516ac3b5773'} Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:09:40.195970 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:09:40.197417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:09:40.198991 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Returning 404 to user: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:09:40.198991 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7f68e497-2551-4f80-8c4b-53bba3a6b594 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 404 len: 111 microversion: 2.1 time: 0.030877 Sep 24 15:09:40.198991 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 503/1016] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:40 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:09:40.289627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1343374454", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2128561527", "security_groups": [{"name": "tempest-secgroup-smoke-2056141905"}], "block_device_mapping_v2": [{"uuid": "a74c4edc-4d1c-4219-9860-93a5a15423a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8b98b34-a708-4aa1-8351-cc592752fa2b"}]}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:09:40.400562 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] validate_networks() for [('a8b98b34-a708-4aa1-8351-cc592752fa2b', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:09:40.758745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:09:40.759180 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:09:40.759731 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:09:40.760192 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:09:40.760667 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:09:40.769983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:40.770482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:40.770908 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:40.771632 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:40.772090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:40.772515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:40.789018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Getting quotas for project cd72399e0d4f4e25b992e8e8cf836c18. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:09:40.792930 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Getting quotas for user 5a93a2d9266541e7bff502ba074fef5c and project cd72399e0d4f4e25b992e8e8cf836c18. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:09:40.848138 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:09:40.850832 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a74c4edc-4d1c-4219-9860-93a5a15423a2',volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:09:40.978482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d78a484e-4019-4d1d-99c7-1810e0d8c9eb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693268 Sep 24 15:09:40.979439 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 514/1017] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:09:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:09:40.990994 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-a4aad85e-7fa2-4bf2-8b45-70ceca26bf1d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:40.991693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-a4aad85e-7fa2-4bf2-8b45-70ceca26bf1d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:41.044566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-a4aad85e-7fa2-4bf2-8b45-70ceca26bf1d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:41.051380 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-a4aad85e-7fa2-4bf2-8b45-70ceca26bf1d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1095 microversion: 2.1 time: 0.065075 Sep 24 15:09:41.052913 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 504/1018] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:40 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:42.080128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:42.080128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:42.087598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:42.088103 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:42.088553 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:42.089272 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:42.090683 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:42.091151 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:42.184337 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:42.193283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-28a16bc2-7641-4ee3-8e8c-feebd096aaac tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1201 microversion: 2.1 time: 0.121453 Sep 24 15:09:42.194186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 515/1019] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:42 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1201 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:43.216338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:43.217015 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:43.224478 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:43.224984 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:43.225721 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:43.226456 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:43.226929 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:43.227401 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:43.365814 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:43.374149 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-53ee0194-2368-4c8b-9b56-c849b278a3fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.161675 Sep 24 15:09:43.374861 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 505/1020] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:43 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:43.554802 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-08d8942b-4866-424d-947b-500da4c7c91e req-1dfe74da-48cc-4333-9541-619e03e29e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de7e1cd-a661-41b9-bcd8-e4ab67c432ab", "tag": "8c6c7f66-b862-4791-a698-9b5965a87bf3"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:09:43.565631 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-08d8942b-4866-424d-947b-500da4c7c91e req-1dfe74da-48cc-4333-9541-619e03e29e39 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:43.566163 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-08d8942b-4866-424d-947b-500da4c7c91e req-1dfe74da-48cc-4333-9541-619e03e29e39 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:43.566640 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-08d8942b-4866-424d-947b-500da4c7c91e req-1dfe74da-48cc-4333-9541-619e03e29e39 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:43.578235 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-08d8942b-4866-424d-947b-500da4c7c91e req-1dfe74da-48cc-4333-9541-619e03e29e39 service nova] Creating event network-changed:8c6c7f66-b862-4791-a698-9b5965a87bf3 for instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab on hv-cinder-85919 Sep 24 15:09:43.583102 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-08d8942b-4866-424d-947b-500da4c7c91e req-1dfe74da-48cc-4333-9541-619e03e29e39 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032566 Sep 24 15:09:43.583716 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 516/1021] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:09:44.397720 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:44.398382 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:44.404827 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:44.405324 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:44.405773 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:44.406509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:44.406980 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:44.407420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:44.539413 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:44.547267 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8f86e1c8-e2dd-4995-b5d2-b494752f74f8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.153934 Sep 24 15:09:44.547783 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 506/1022] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:44 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:09:45.570977 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:45.571610 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:45.577663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:45.578185 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:45.578627 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:45.579320 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:45.579784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:45.580216 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:45.713436 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:45.721008 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-380a0d19-4b80-4020-9b40-14cec2ba7e9d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.155282 Sep 24 15:09:45.721569 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 517/1023] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:45 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:46.742974 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:46.743853 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:46.745879 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:46.751335 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:46.751865 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:46.752315 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:46.753023 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:46.753487 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:46.753937 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:46.759198 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:46.884307 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:46.891974 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-60178697-7982-450f-985d-6ff8bf9b2679 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.153035 Sep 24 15:09:46.892905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 507/1024] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:46 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:47.915467 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:47.916079 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:47.918246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:47.923527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:47.924023 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:47.924465 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:47.925162 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:47.925622 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:47.926097 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:47.931309 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:48.060995 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:48.070803 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c04e609d-d5b9-4684-ad2a-57c828ecf85e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.159189 Sep 24 15:09:48.071381 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 518/1025] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:47 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:09:49.094158 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:49.094787 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:49.101279 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:49.101778 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:49.102265 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:49.102969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:49.103438 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:49.103877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:49.236203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:49.244102 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2c59ce72-ac46-45cb-b5dc-c6a5613d0b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.153652 Sep 24 15:09:49.244678 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 508/1026] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:49 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:50.267172 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:50.267788 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:50.274726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:50.275224 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:50.275671 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:50.276359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:50.276819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:50.277248 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:50.402380 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:50.410003 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-dd0984bf-53d2-45f6-90cf-b46adcd01da4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.146606 Sep 24 15:09:50.410576 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 519/1027] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:50 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:51.433483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:51.434163 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:51.436441 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:51.441914 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:51.442452 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:51.442903 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:51.443611 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:51.444115 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:51.444555 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:51.573081 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:51.580963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bcbf5fd1-3f32-48a7-9ab2-c4d966c6584b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.151372 Sep 24 15:09:51.581541 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 509/1028] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:51 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:52.603302 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:52.603912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:52.605697 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:52.606372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=6 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:09:52.612806 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:52.613292 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:52.613727 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:52.614944 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:52.615401 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:52.615827 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:52.920245 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:52.928747 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9df645de-f2c9-4bb9-a7f4-89bc70fa4433 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.329241 Sep 24 15:09:52.929316 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 520/1029] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:52 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:53.727056 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-ba7cba5c-5548-451b-9a4f-aa053bcea22a req-f8ee3cce-cf43-4ac3-b78e-acd643e92fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de7e1cd-a661-41b9-bcd8-e4ab67c432ab", "name": "network-vif-plugged", "status": "completed", "tag": "8c6c7f66-b862-4791-a698-9b5965a87bf3"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:09:53.736793 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ba7cba5c-5548-451b-9a4f-aa053bcea22a req-f8ee3cce-cf43-4ac3-b78e-acd643e92fae service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:53.737292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ba7cba5c-5548-451b-9a4f-aa053bcea22a req-f8ee3cce-cf43-4ac3-b78e-acd643e92fae service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:53.737737 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-ba7cba5c-5548-451b-9a4f-aa053bcea22a req-f8ee3cce-cf43-4ac3-b78e-acd643e92fae service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:53.748969 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-ba7cba5c-5548-451b-9a4f-aa053bcea22a req-f8ee3cce-cf43-4ac3-b78e-acd643e92fae service nova] Creating event network-vif-plugged:8c6c7f66-b862-4791-a698-9b5965a87bf3 for instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab on hv-cinder-85919 Sep 24 15:09:53.753927 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-ba7cba5c-5548-451b-9a4f-aa053bcea22a req-f8ee3cce-cf43-4ac3-b78e-acd643e92fae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030520 Sep 24 15:09:53.754581 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 510/1030] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:09:53.952390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:53.952922 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:53.960101 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:53.960593 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:53.961031 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:53.961730 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:53.962212 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:53.962663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:54.132422 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:54.140240 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-932422f2-b376-4e27-823b-c49b952c7660 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.192534 Sep 24 15:09:54.140802 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 521/1031] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:53 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:55.163620 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:55.164324 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:55.170490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:55.170987 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:55.171427 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:55.172124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:55.172588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:55.173020 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:55.356394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:55.363982 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-3bb97a44-5041-4717-a718-1f5194718986 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1267 microversion: 2.1 time: 0.205188 Sep 24 15:09:55.364572 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 511/1032] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:55 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:56.386913 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:56.387531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:56.393768 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:56.394291 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:56.394725 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:56.395413 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:56.395868 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:56.396295 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:56.532090 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:56.539623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d8a8a1a4-a5ff-47cb-a9e0-8110128176c4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1453 microversion: 2.1 time: 0.156544 Sep 24 15:09:56.540184 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 522/1033] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:56 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:09:56.561152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:09:56.561811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:09:56.568340 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:56.569320 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:56.569762 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:56.571123 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:56.571588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:56.572019 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:56.698236 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:09:56.705940 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-12a0c534-e344-403a-b770-270375da9f7a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1453 microversion: 2.1 time: 0.148645 Sep 24 15:09:56.706509 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 512/1034] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:09:56 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:09:58.522565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-1ac6bc94-ce3c-4fac-94ef-10bcb6836834 req-ba6bad97-c4d9-499f-9f66-6144b52cab31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de7e1cd-a661-41b9-bcd8-e4ab67c432ab", "tag": "8c6c7f66-b862-4791-a698-9b5965a87bf3"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:09:58.532819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-1ac6bc94-ce3c-4fac-94ef-10bcb6836834 req-ba6bad97-c4d9-499f-9f66-6144b52cab31 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:09:58.533413 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-1ac6bc94-ce3c-4fac-94ef-10bcb6836834 req-ba6bad97-c4d9-499f-9f66-6144b52cab31 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:09:58.533928 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-1ac6bc94-ce3c-4fac-94ef-10bcb6836834 req-ba6bad97-c4d9-499f-9f66-6144b52cab31 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:09:58.545947 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-1ac6bc94-ce3c-4fac-94ef-10bcb6836834 req-ba6bad97-c4d9-499f-9f66-6144b52cab31 service nova] Creating event network-changed:8c6c7f66-b862-4791-a698-9b5965a87bf3 for instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab on hv-cinder-85919 Sep 24 15:09:58.551132 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-1ac6bc94-ce3c-4fac-94ef-10bcb6836834 req-ba6bad97-c4d9-499f-9f66-6144b52cab31 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032334 Sep 24 15:09:58.551848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 523/1035] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:10:02.437221 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-1da91581-7f54-40c3-97c8-77d188d90f9e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:02.439448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-1da91581-7f54-40c3-97c8-77d188d90f9e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:02.446637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da91581-7f54-40c3-97c8-77d188d90f9e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:02.447124 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da91581-7f54-40c3-97c8-77d188d90f9e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:02.447565 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da91581-7f54-40c3-97c8-77d188d90f9e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:02.448260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da91581-7f54-40c3-97c8-77d188d90f9e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:02.448724 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da91581-7f54-40c3-97c8-77d188d90f9e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:02.449154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-1da91581-7f54-40c3-97c8-77d188d90f9e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:02.477710 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-1da91581-7f54-40c3-97c8-77d188d90f9e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044467 Sep 24 15:10:02.478359 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 513/1036] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:10:02 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 15:10:02.540984 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:02.541565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:02.547557 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:02.548044 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:02.548480 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:02.549172 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:02.549625 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:02.550085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:02.574493 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Going to try to terminate instance {{(pid=120590) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:10:02.647859 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-344ea0f7-9ed3-4971-a7d8-7ee9c371734e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 204 len: 0 microversion: 2.1 time: 0.110707 Sep 24 15:10:02.648789 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 524/1037] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:10:02 2022] DELETE /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:10:02.657246 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:02.657879 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:02.663752 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:02.664247 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:02.664693 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:02.665393 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:02.665859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:02.666327 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:02.799312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:02.807276 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-88fb718a-4fc6-4178-9b74-6989856001ec tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1671 microversion: 2.1 time: 0.154063 Sep 24 15:10:02.807844 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 514/1038] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:02 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:03.832057 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:03.832754 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:03.839536 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:03.840025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:03.840461 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:03.841146 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:03.841602 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:03.842058 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:03.973264 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:03.981509 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-2da99f8a-b863-4d31-af82-60df6f19f00e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1671 microversion: 2.1 time: 0.153721 Sep 24 15:10:03.982094 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 525/1039] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:03 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:05.004634 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:05.005260 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:05.011652 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:05.012147 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:05.012604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:05.013309 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:05.013776 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:05.014243 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:05.147347 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:05.156782 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-97859254-5089-4c18-ac25-4938727cce76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1671 microversion: 2.1 time: 0.154491 Sep 24 15:10:05.166394 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 515/1040] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:04 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:06.180784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:06.181402 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:06.188280 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:06.188781 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:06.189285 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:06.190260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:06.190810 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:06.191297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:06.211042 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-50ef6047-a032-459c-9b57-301c0148018f req-a673a243-7da9-4deb-9cc4-b798d5e3cdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8c8f87-40c5-41e2-9606-068157651b71", "name": "network-vif-deleted", "tag": "63be67c4-6966-4c64-9a99-fa23e11f7821"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:10:06.220792 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-50ef6047-a032-459c-9b57-301c0148018f req-a673a243-7da9-4deb-9cc4-b798d5e3cdf0 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:06.221412 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-50ef6047-a032-459c-9b57-301c0148018f req-a673a243-7da9-4deb-9cc4-b798d5e3cdf0 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:06.221854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-50ef6047-a032-459c-9b57-301c0148018f req-a673a243-7da9-4deb-9cc4-b798d5e3cdf0 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:06.234243 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-50ef6047-a032-459c-9b57-301c0148018f req-a673a243-7da9-4deb-9cc4-b798d5e3cdf0 service nova] Creating event network-vif-deleted:63be67c4-6966-4c64-9a99-fa23e11f7821 for instance 0c8c8f87-40c5-41e2-9606-068157651b71 on hv-cinder-85919 Sep 24 15:10:06.241826 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-50ef6047-a032-459c-9b57-301c0148018f req-a673a243-7da9-4deb-9cc4-b798d5e3cdf0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034894 Sep 24 15:10:06.242488 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 516/1041] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:10:06.267277 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:06.277569 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e8ff455f-65b6-4091-9e6f-9accb54e4c6a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 200 len: 1603 microversion: 2.1 time: 0.099479 Sep 24 15:10:06.278563 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 526/1042] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:06 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 1603 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:07.303079 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:07.303817 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:07.310045 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:07.310540 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:07.310987 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:07.311688 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:07.312155 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:07.312591 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:07.326521 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] HTTP exception thrown: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Request method failure captured: Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 HTTP/1.1 Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLx0c7OD8LETaTkbvOdEBZydpTt4jCz0uF7nOEhNKkE-Cazm8Q8W6a__TKykFqKhzvpVCnUgX7bKbSg--1q7_zFDVUVD_ofucVAN6DQb5z-W8kgX-0Ly4YbKgngyNw9GH6YgYieFqxyBmrnX20rFP4a9Zerc8lZU-dMqUOqJzA8F8YyY Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: a860b6979be5483dba888a37634d196b Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:10:07.328165 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a860b6979be5483dba888a37634d196b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a860b6979be5483dba888a37634d196b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}] Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: a860b6979be5483dba888a37634d196b Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 5d10a2be3765418cb72eeb6b15db5142 Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:10:07.329765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '0c8c8f87-40c5-41e2-9606-068157651b71'} Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:10:07.330628 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:10:07.331855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:10:07.332963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Returning 404 to user: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:10:07.332963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-15747758-9f34-44bd-b370-5a1b7a804740 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 404 len: 111 microversion: 2.1 time: 0.031260 Sep 24 15:10:07.332963 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 517/1043] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:07 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:10:07.339086 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3b40896d-8231-425d-b834-098296017c79 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '.version_select at 0x7f7c1445bca0>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:07.343739 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b40896d-8231-425d-b834-098296017c79 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [b11b8c1d-8ee9-4b91-9f28-6b60dd8071f9] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 15:10:08.352089 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b40896d-8231-425d-b834-098296017c79 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [b11b8c1d-8ee9-4b91-9f28-6b60dd8071f9] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 46412. Sep 24 15:10:08.370289 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3b40896d-8231-425d-b834-098296017c79 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118495739" status: 202 len: 0 microversion: 2.1 time: 1.035033 Sep 24 15:10:08.370864 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 527/1044] 10.222.0.61 () {58 vars in 1221 bytes} [Sat Sep 24 15:10:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118495739 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:10:08.991363 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f2b7159f-58e2-488e-9c12-ca593f6a9237 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'create', calling method: .version_select at 0x7f7c10bcb3a0>, body: {"keypair": {"name": "tempest-keypair-559935580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS7SRF81MnYB55n5xC3GAeUpWRwc6skLBcAo3d04cdYrfly6wC801bi6PVz77J11pOz02TGCBLOM+b00dYL3R31MbURYOoffPIH65k2vB0c+O9sSTDpPDe42PM1k934kw=="}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:10:09.007576 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-f2b7159f-58e2-488e-9c12-ca593f6a9237 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Getting quotas for project a860b6979be5483dba888a37634d196b. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:10:09.011448 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-f2b7159f-58e2-488e-9c12-ca593f6a9237 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Getting quotas for user 5d10a2be3765418cb72eeb6b15db5142 and project a860b6979be5483dba888a37634d196b. Resources: {'key_pairs'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:10:09.023636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f2b7159f-58e2-488e-9c12-ca593f6a9237 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [61f08af2-207a-4d3a-ac77-b6227a840953] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 15:10:10.030334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO oslo.messaging._drivers.impl_rabbit [None req-f2b7159f-58e2-488e-9c12-ca593f6a9237 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [61f08af2-207a-4d3a-ac77-b6227a840953] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 46426. Sep 24 15:10:10.044447 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f2b7159f-58e2-488e-9c12-ca593f6a9237 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.057439 Sep 24 15:10:10.045047 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 518/1045] 10.222.0.61 () {60 vars in 1159 bytes} [Sat Sep 24 15:10:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:10:11.279018 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2102531777", "imageRef": "3cf7897d-e57a-4d70-b6f3-70e0db95d961", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a69607cb-498b-4bf9-9145-fd54341c6030"}], "security_groups": [{"name": "tempest-securitygroup--1120411154"}], "key_name": "tempest-keypair-559935580", "user_data": "}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:10:11.379312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.network.neutron [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] validate_networks() for [('a69607cb-498b-4bf9-9145-fd54341c6030', None, None, None, None, None)] {{(pid=120590) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:10:11.746333 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Flavor limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:10:11.746765 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Image limits 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:10:11.747246 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Flavor pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:10:11.747662 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Image pref 0:0:0 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:10:11.748076 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.virt.hardware [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:10:11.757107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:11.757598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:11.758080 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:11.758812 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:11.759277 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:11.759705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:11.776390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Getting quotas for project a860b6979be5483dba888a37634d196b. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:10:11.780371 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.quota [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Getting quotas for user 5d10a2be3765418cb72eeb6b15db5142 and project a860b6979be5483dba888a37634d196b. Resources: {'instances', 'ram', 'cores'} {{(pid=120590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:10:11.791110 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Going to run 1 instances... {{(pid=120590) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:10:11.793369 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3cf7897d-e57a-4d70-b6f3-70e0db95d961',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:10:11.843898 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-aee5e627-83ad-49d9-a8bc-56331ec69b67 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.569784 Sep 24 15:10:11.850236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 528/1046] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:10:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:10:11.853638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 15:10:11.854141 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Sat Sep 24 15:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 (ip 10.222.0.61) !!! Sep 24 15:10:11.859912 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d25421d4-20ef-4b2f-b0c9-4f4df7fc5bbf tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:11.860768 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d25421d4-20ef-4b2f-b0c9-4f4df7fc5bbf tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:11.921386 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d25421d4-20ef-4b2f-b0c9-4f4df7fc5bbf tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:11.929709 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d25421d4-20ef-4b2f-b0c9-4f4df7fc5bbf tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1237 microversion: 2.1 time: 0.076648 Sep 24 15:10:11.930704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 519/1047] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:11 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:12.953278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:12.954024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:12.961004 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:12.961506 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:12.961976 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:12.962692 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:12.963159 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:12.963599 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:13.070743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:13.078729 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-9ae9c07e-01b7-4a79-aa6d-d8c6688585a2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1297 microversion: 2.1 time: 0.129990 Sep 24 15:10:13.079312 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 529/1048] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:12 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:14.102656 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:14.103200 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:14.110436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:14.110965 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:14.111415 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:14.112122 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:14.112585 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:14.113026 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:14.246382 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:14.253962 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8dba8700-4bbf-44ba-8349-192f04bfe034 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1363 microversion: 2.1 time: 0.155337 Sep 24 15:10:14.254537 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 520/1049] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:14 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:14.465303 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-9f180418-2338-420b-acd1-133aac88873b req-ae220383-1af0-4c72-887f-cf12fca32a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da2b14db-6aa6-44ce-9feb-d990f6424504", "tag": "5050eb57-e557-4d82-9f24-06be1abc9526"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:10:14.477404 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-9f180418-2338-420b-acd1-133aac88873b req-ae220383-1af0-4c72-887f-cf12fca32a2c service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:14.477932 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-9f180418-2338-420b-acd1-133aac88873b req-ae220383-1af0-4c72-887f-cf12fca32a2c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:14.478554 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-9f180418-2338-420b-acd1-133aac88873b req-ae220383-1af0-4c72-887f-cf12fca32a2c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:14.491083 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-9f180418-2338-420b-acd1-133aac88873b req-ae220383-1af0-4c72-887f-cf12fca32a2c service nova] Creating event network-changed:5050eb57-e557-4d82-9f24-06be1abc9526 for instance da2b14db-6aa6-44ce-9feb-d990f6424504 on hv-cinder-85919 Sep 24 15:10:14.496497 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-9f180418-2338-420b-acd1-133aac88873b req-ae220383-1af0-4c72-887f-cf12fca32a2c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035563 Sep 24 15:10:14.497260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 530/1050] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:10:15.278582 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:15.279227 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:15.285579 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:15.286107 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:15.286595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:15.287836 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:15.288305 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:15.288746 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:15.418237 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:15.425812 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-87eb8a69-efe2-4b65-abb1-08c3680f614d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1363 microversion: 2.1 time: 0.151201 Sep 24 15:10:15.426417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 521/1051] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:15 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:16.449579 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:16.450287 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:16.457053 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:16.457543 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:16.458036 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:16.459267 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:16.459739 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:16.460177 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:16.584369 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:16.591967 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4b751d9e-a6df-4695-a860-bb13fbd88613 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1363 microversion: 2.1 time: 0.146782 Sep 24 15:10:16.592539 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 531/1052] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:16 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:17.613891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:17.614566 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:17.617435 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:10:17.622961 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:17.623458 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:17.623910 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:17.624619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:17.625088 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:17.625525 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:17.628786 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=66 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:10:17.754900 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:17.762670 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e908a723-0708-4d9b-815c-bd4ff6840f53 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1363 microversion: 2.1 time: 0.152649 Sep 24 15:10:17.763255 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 522/1053] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:17 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:18.785386 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:18.786050 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:18.787963 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:10:18.793868 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:18.794385 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:18.794825 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:18.795515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:18.795972 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:18.796399 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:18.799445 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:10:18.934119 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:18.943795 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d0602457-4069-4eee-96e5-532fc2d022c2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1363 microversion: 2.1 time: 0.161690 Sep 24 15:10:18.944377 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 532/1054] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:18 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:19.966319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:19.966859 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:19.973190 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:19.973680 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:19.974154 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:19.974851 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:19.975307 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:19.975732 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:19.989198 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-a4537b40-0244-4429-84b2-cfd51d0f3515 req-5fa84080-5003-46d3-a7da-e1655f8752f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2b14db-6aa6-44ce-9feb-d990f6424504", "name": "network-vif-plugged", "status": "completed", "tag": "5050eb57-e557-4d82-9f24-06be1abc9526"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:10:20.000434 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a4537b40-0244-4429-84b2-cfd51d0f3515 req-5fa84080-5003-46d3-a7da-e1655f8752f5 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:20.001085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a4537b40-0244-4429-84b2-cfd51d0f3515 req-5fa84080-5003-46d3-a7da-e1655f8752f5 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:20.001636 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-a4537b40-0244-4429-84b2-cfd51d0f3515 req-5fa84080-5003-46d3-a7da-e1655f8752f5 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:20.013556 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-a4537b40-0244-4429-84b2-cfd51d0f3515 req-5fa84080-5003-46d3-a7da-e1655f8752f5 service nova] Creating event network-vif-plugged:5050eb57-e557-4d82-9f24-06be1abc9526 for instance da2b14db-6aa6-44ce-9feb-d990f6424504 on hv-cinder-85919 Sep 24 15:10:20.018677 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-a4537b40-0244-4429-84b2-cfd51d0f3515 req-5fa84080-5003-46d3-a7da-e1655f8752f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033911 Sep 24 15:10:20.019364 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 533/1055] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:10:20.113777 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:20.123304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-91873de5-a2aa-4062-9026-bc3806e53ca3 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1363 microversion: 2.1 time: 0.161118 Sep 24 15:10:20.123931 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 523/1056] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:19 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:21.147985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:21.148685 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:21.154792 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:21.155306 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:21.155744 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:21.156431 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:21.156886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:21.157317 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:21.284911 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:21.292628 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-62c11656-32fa-4acc-b986-cf26302b681b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1363 microversion: 2.1 time: 0.149746 Sep 24 15:10:21.293207 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 534/1057] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:21 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:22.315633 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:22.316259 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:22.319343 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:10:22.324704 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:22.325197 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:22.325638 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:22.326368 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:22.326832 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:22.327262 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:22.453437 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:10:22.461024 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-59edf975-96b1-47db-b5fc-8c54e6c3a81e tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1549 microversion: 2.1 time: 0.149333 Sep 24 15:10:22.461584 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 524/1058] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:10:22 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:10:22.482828 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bf315041-ad59-427f-aaf1-34b6efd26f3d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:22.483338 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bf315041-ad59-427f-aaf1-34b6efd26f3d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:22.485213 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:10:22.486107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=6 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:10:22.493069 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf315041-ad59-427f-aaf1-34b6efd26f3d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:22.493560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf315041-ad59-427f-aaf1-34b6efd26f3d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:22.494300 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf315041-ad59-427f-aaf1-34b6efd26f3d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:22.494993 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf315041-ad59-427f-aaf1-34b6efd26f3d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:22.495456 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf315041-ad59-427f-aaf1-34b6efd26f3d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:22.495886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bf315041-ad59-427f-aaf1-34b6efd26f3d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:22.574324 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bf315041-ad59-427f-aaf1-34b6efd26f3d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095257 Sep 24 15:10:22.574939 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 535/1059] 10.222.0.61 () {58 vars in 1275 bytes} [Sat Sep 24 15:10:22 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:10:23.478407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-abde4abb-31b8-497d-83e5-75bb73678dd5 req-3b64f59b-b1de-4afb-ac29-dfa17795514c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da2b14db-6aa6-44ce-9feb-d990f6424504", "tag": "5050eb57-e557-4d82-9f24-06be1abc9526"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:10:23.488198 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-abde4abb-31b8-497d-83e5-75bb73678dd5 req-3b64f59b-b1de-4afb-ac29-dfa17795514c service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:23.488684 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-abde4abb-31b8-497d-83e5-75bb73678dd5 req-3b64f59b-b1de-4afb-ac29-dfa17795514c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:23.489126 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-abde4abb-31b8-497d-83e5-75bb73678dd5 req-3b64f59b-b1de-4afb-ac29-dfa17795514c service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:23.500817 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-abde4abb-31b8-497d-83e5-75bb73678dd5 req-3b64f59b-b1de-4afb-ac29-dfa17795514c service nova] Creating event network-changed:5050eb57-e557-4d82-9f24-06be1abc9526 for instance da2b14db-6aa6-44ce-9feb-d990f6424504 on hv-cinder-85919 Sep 24 15:10:23.506338 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-abde4abb-31b8-497d-83e5-75bb73678dd5 req-3b64f59b-b1de-4afb-ac29-dfa17795514c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031751 Sep 24 15:10:23.506936 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 525/1060] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:10:59.300517 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=7 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:10:59.301384 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=17 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:10:59.306395 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-781e180e-be3d-4532-8ea8-59b58595765a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:10:59.306901 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-781e180e-be3d-4532-8ea8-59b58595765a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:10:59.313679 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-781e180e-be3d-4532-8ea8-59b58595765a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:59.314202 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-781e180e-be3d-4532-8ea8-59b58595765a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:59.314653 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-781e180e-be3d-4532-8ea8-59b58595765a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:59.315356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-781e180e-be3d-4532-8ea8-59b58595765a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:10:59.315824 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-781e180e-be3d-4532-8ea8-59b58595765a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:10:59.316262 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-781e180e-be3d-4532-8ea8-59b58595765a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:10:59.342620 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-781e180e-be3d-4532-8ea8-59b58595765a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/ips" status: 200 len: 146 microversion: 2.1 time: 0.043551 Sep 24 15:10:59.343674 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 536/1061] 10.222.0.61 () {58 vars in 1248 bytes} [Sat Sep 24 15:10:59 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:11:00.666507 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=7 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:11:00.667256 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=19 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:11:00.671707 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-93d38aab-d1fb-4add-8600-615c18b51da1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a871270-3eb3-4a27-a91c-f0a2829e5131"}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:11:00.674213 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-93d38aab-d1fb-4add-8600-615c18b51da1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:00.681495 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93d38aab-d1fb-4add-8600-615c18b51da1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:00.682083 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93d38aab-d1fb-4add-8600-615c18b51da1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:00.682538 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93d38aab-d1fb-4add-8600-615c18b51da1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:00.683403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93d38aab-d1fb-4add-8600-615c18b51da1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:00.683892 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93d38aab-d1fb-4add-8600-615c18b51da1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:00.684334 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-93d38aab-d1fb-4add-8600-615c18b51da1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:00.947232 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-93d38aab-d1fb-4add-8600-615c18b51da1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282216 Sep 24 15:11:00.947839 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 526/1062] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:11:00 2022] POST /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:08.477557 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-4a4feef9-33b3-422e-94f3-ead3cc59789a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:08.479770 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-4a4feef9-33b3-422e-94f3-ead3cc59789a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:08.486171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a4feef9-33b3-422e-94f3-ead3cc59789a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:08.486663 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a4feef9-33b3-422e-94f3-ead3cc59789a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:08.487107 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a4feef9-33b3-422e-94f3-ead3cc59789a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:08.487797 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a4feef9-33b3-422e-94f3-ead3cc59789a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:08.488262 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a4feef9-33b3-422e-94f3-ead3cc59789a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:08.488714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-4a4feef9-33b3-422e-94f3-ead3cc59789a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:08.518465 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-4a4feef9-33b3-422e-94f3-ead3cc59789a tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Sep 24 15:11:08.519025 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 537/1063] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:11:08 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:08.531270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-7915a72d-51fc-484f-89fd-3767e561ca19 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:08.531866 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-7915a72d-51fc-484f-89fd-3767e561ca19 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:08.538098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7915a72d-51fc-484f-89fd-3767e561ca19 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:08.538596 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7915a72d-51fc-484f-89fd-3767e561ca19 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:08.539044 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7915a72d-51fc-484f-89fd-3767e561ca19 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:08.539745 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7915a72d-51fc-484f-89fd-3767e561ca19 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:08.540214 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7915a72d-51fc-484f-89fd-3767e561ca19 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:08.540651 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-7915a72d-51fc-484f-89fd-3767e561ca19 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:08.568972 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-7915a72d-51fc-484f-89fd-3767e561ca19 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1a871270-3eb3-4a27-a91c-f0a2829e5131" status: 200 len: 194 microversion: 2.1 time: 0.042493 Sep 24 15:11:08.569549 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 527/1064] 10.222.0.61 () {58 vars in 1413 bytes} [Sat Sep 24 15:11:08 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1a871270-3eb3-4a27-a91c-f0a2829e5131 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:09.895688 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3fc78900-f152-46d1-91ca-a3c5d0476cc5 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cc27d51-a253-472c-8d0d-4c974a30d8c7"}} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:11:09.898009 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3fc78900-f152-46d1-91ca-a3c5d0476cc5 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:09.904434 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fc78900-f152-46d1-91ca-a3c5d0476cc5 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:09.904921 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fc78900-f152-46d1-91ca-a3c5d0476cc5 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:09.905356 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fc78900-f152-46d1-91ca-a3c5d0476cc5 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:09.906071 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fc78900-f152-46d1-91ca-a3c5d0476cc5 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:09.906531 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fc78900-f152-46d1-91ca-a3c5d0476cc5 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:09.906958 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3fc78900-f152-46d1-91ca-a3c5d0476cc5 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:10.171191 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3fc78900-f152-46d1-91ca-a3c5d0476cc5 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "POST /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279652 Sep 24 15:11:10.171906 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 538/1065] 10.222.0.61 () {60 vars in 1323 bytes} [Sat Sep 24 15:11:09 2022] POST /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:17.717143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-f31920b8-fac4-4bf6-8dfa-da15627dc822 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:17.719552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-f31920b8-fac4-4bf6-8dfa-da15627dc822 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:17.726050 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f31920b8-fac4-4bf6-8dfa-da15627dc822 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:17.726549 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f31920b8-fac4-4bf6-8dfa-da15627dc822 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:17.726997 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f31920b8-fac4-4bf6-8dfa-da15627dc822 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:17.727694 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f31920b8-fac4-4bf6-8dfa-da15627dc822 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:17.728161 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f31920b8-fac4-4bf6-8dfa-da15627dc822 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:17.728597 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-f31920b8-fac4-4bf6-8dfa-da15627dc822 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:17.759361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-f31920b8-fac4-4bf6-8dfa-da15627dc822 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046090 Sep 24 15:11:17.760196 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 528/1066] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:11:17 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:17.900886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6f907a82-3fa2-4f7d-93d5-76c18d277689 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:17.901412 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6f907a82-3fa2-4f7d-93d5-76c18d277689 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:17.907530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f907a82-3fa2-4f7d-93d5-76c18d277689 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:17.908026 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f907a82-3fa2-4f7d-93d5-76c18d277689 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:17.908473 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f907a82-3fa2-4f7d-93d5-76c18d277689 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:17.909176 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f907a82-3fa2-4f7d-93d5-76c18d277689 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:17.909643 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f907a82-3fa2-4f7d-93d5-76c18d277689 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:17.910129 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6f907a82-3fa2-4f7d-93d5-76c18d277689 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:17.938777 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6f907a82-3fa2-4f7d-93d5-76c18d277689 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1a871270-3eb3-4a27-a91c-f0a2829e5131" status: 200 len: 194 microversion: 2.1 time: 0.042785 Sep 24 15:11:17.939365 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 539/1067] 10.222.0.61 () {58 vars in 1413 bytes} [Sat Sep 24 15:11:17 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1a871270-3eb3-4a27-a91c-f0a2829e5131 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:17.950397 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:17.950897 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:17.956658 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:17.957147 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:17.957586 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:17.958304 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:17.958768 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:17.959226 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:18.040485 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lazy-loading 'services' on Instance uuid da2b14db-6aa6-44ce-9feb-d990f6424504 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:11:18.111012 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-799ed233-a0a6-4b77-96ed-56dc5d22b9c6 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "DELETE /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1a871270-3eb3-4a27-a91c-f0a2829e5131" status: 202 len: 0 microversion: 2.1 time: 0.164409 Sep 24 15:11:18.111597 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 529/1068] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:11:17 2022] DELETE /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1a871270-3eb3-4a27-a91c-f0a2829e5131 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:11:19.234560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-f026c9ea-35af-44b8-8841-ccfb1ade0f0d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:19.235127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-f026c9ea-35af-44b8-8841-ccfb1ade0f0d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:19.241357 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f026c9ea-35af-44b8-8841-ccfb1ade0f0d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:19.241840 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f026c9ea-35af-44b8-8841-ccfb1ade0f0d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:19.242308 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f026c9ea-35af-44b8-8841-ccfb1ade0f0d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:19.243263 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f026c9ea-35af-44b8-8841-ccfb1ade0f0d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:19.243716 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f026c9ea-35af-44b8-8841-ccfb1ade0f0d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:19.244138 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-f026c9ea-35af-44b8-8841-ccfb1ade0f0d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:19.272717 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-f026c9ea-35af-44b8-8841-ccfb1ade0f0d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1cc27d51-a253-472c-8d0d-4c974a30d8c7" status: 200 len: 194 microversion: 2.1 time: 0.042196 Sep 24 15:11:19.273298 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 540/1069] 10.222.0.61 () {58 vars in 1413 bytes} [Sat Sep 24 15:11:19 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1cc27d51-a253-472c-8d0d-4c974a30d8c7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:19.284848 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:19.285439 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:19.291522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:19.292016 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:19.292464 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:19.293162 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:19.293624 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:19.294092 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:19.373924 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.objects.instance [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lazy-loading 'services' on Instance uuid da2b14db-6aa6-44ce-9feb-d990f6424504 {{(pid=120591) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 15:11:19.446681 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-b2ef1f35-1660-4894-8c83-924352894fa1 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "DELETE /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1cc27d51-a253-472c-8d0d-4c974a30d8c7" status: 202 len: 0 microversion: 2.1 time: 0.166534 Sep 24 15:11:19.447271 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 530/1070] 10.222.0.61 () {58 vars in 1416 bytes} [Sat Sep 24 15:11:19 2022] DELETE /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments/1cc27d51-a253-472c-8d0d-4c974a30d8c7 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:11:20.627022 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-a081fb87-8259-42ce-8999-bd5fd7640893 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:20.629271 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-a081fb87-8259-42ce-8999-bd5fd7640893 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:20.635743 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a081fb87-8259-42ce-8999-bd5fd7640893 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:20.636242 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a081fb87-8259-42ce-8999-bd5fd7640893 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:20.636689 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a081fb87-8259-42ce-8999-bd5fd7640893 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:20.637389 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a081fb87-8259-42ce-8999-bd5fd7640893 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:20.637855 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a081fb87-8259-42ce-8999-bd5fd7640893 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:20.638322 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-a081fb87-8259-42ce-8999-bd5fd7640893 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:20.666907 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-a081fb87-8259-42ce-8999-bd5fd7640893 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043768 Sep 24 15:11:20.667467 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 541/1071] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:11:20 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 15:11:20.783861 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-71506891-d6ec-4e39-94d8-c31ec705d944 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:20.786674 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-71506891-d6ec-4e39-94d8-c31ec705d944 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:20.792758 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71506891-d6ec-4e39-94d8-c31ec705d944 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:20.793252 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71506891-d6ec-4e39-94d8-c31ec705d944 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:20.793745 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71506891-d6ec-4e39-94d8-c31ec705d944 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:20.794454 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71506891-d6ec-4e39-94d8-c31ec705d944 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:20.794916 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71506891-d6ec-4e39-94d8-c31ec705d944 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:20.795350 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-71506891-d6ec-4e39-94d8-c31ec705d944 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:20.826178 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-71506891-d6ec-4e39-94d8-c31ec705d944 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047012 Sep 24 15:11:20.826728 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 531/1072] 10.222.0.61 () {58 vars in 1302 bytes} [Sat Sep 24 15:11:20 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 15:11:20.888920 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:20.889426 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:20.895776 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:20.896271 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:20.896724 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:20.897422 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:20.897887 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:20.898359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:20.923662 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Going to try to terminate instance {{(pid=120590) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:11:20.997120 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6da04482-3464-4be4-a26f-862907ef21ee tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "DELETE /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 204 len: 0 microversion: 2.1 time: 0.111583 Sep 24 15:11:20.997621 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 542/1073] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:11:20 2022] DELETE /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 15:11:21.006089 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:21.006724 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:21.012725 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:21.013210 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:21.013660 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:21.014402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:21.015029 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:21.015477 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:21.144010 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:21.152227 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-31c90bb2-9b89-49f4-8ef1-7f60a71031a7 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1674 microversion: 2.1 time: 0.150337 Sep 24 15:11:21.152802 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 532/1074] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:21 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:22.176985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:22.179152 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:22.185521 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:22.186012 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:22.186454 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:22.187154 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:22.188339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:22.188339 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:22.320301 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:22.327929 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-6dced7c8-7f26-42e8-b81f-a1a4c30b0779 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1674 microversion: 2.1 time: 0.155818 Sep 24 15:11:22.328499 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 543/1075] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:22 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:23.352316 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:23.352944 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:23.359491 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:23.359991 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:23.360464 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:23.361171 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:23.361637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:23.362130 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:23.424438 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d10a2be3765418cb72eeb6b15db5142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a860b6979be5483dba888a37634d196b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:23.435023 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-6749fd86-3fe6-4144-be75-88fddb8e360d tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 200 len: 1606 microversion: 2.1 time: 0.086642 Sep 24 15:11:23.436041 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 533/1076] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:23 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 1606 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:23.781514 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-12053108-b70a-435e-b1a3-cf5fec399680 req-bf197eb4-9360-4c39-8a0f-3bb6c6434297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2b14db-6aa6-44ce-9feb-d990f6424504", "name": "network-vif-deleted", "tag": "5050eb57-e557-4d82-9f24-06be1abc9526"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:11:23.793189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-12053108-b70a-435e-b1a3-cf5fec399680 req-bf197eb4-9360-4c39-8a0f-3bb6c6434297 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:23.794027 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-12053108-b70a-435e-b1a3-cf5fec399680 req-bf197eb4-9360-4c39-8a0f-3bb6c6434297 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:23.794680 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-12053108-b70a-435e-b1a3-cf5fec399680 req-bf197eb4-9360-4c39-8a0f-3bb6c6434297 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:23.807830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-12053108-b70a-435e-b1a3-cf5fec399680 req-bf197eb4-9360-4c39-8a0f-3bb6c6434297 service nova] Creating event network-vif-deleted:5050eb57-e557-4d82-9f24-06be1abc9526 for instance da2b14db-6aa6-44ce-9feb-d990f6424504 on hv-cinder-85919 Sep 24 15:11:23.813257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-12053108-b70a-435e-b1a3-cf5fec399680 req-bf197eb4-9360-4c39-8a0f-3bb6c6434297 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105873 Sep 24 15:11:23.813883 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 544/1077] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:24.460567 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:24.461192 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:24.467842 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:24.468339 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:24.468783 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:24.469490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:24.469979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:24.470417 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:24.485017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] HTTP exception thrown: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Request method failure captured: Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 HTTP/1.1 Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLx0c7OD8LETaTkbvOdEBZydpTt4jCz0uF7nOEhNKkE-Cazm8Q8W6a__TKykFqKhzvpVCnUgX7bKbSg--1q7_zFDVUVD_ofucVAN6DQb5z-W8kgX-0Ly4YbKgngyNw9GH6YgYieFqxyBmrnX20rFP4a9Zerc8lZU-dMqUOqJzA8F8YyY Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:11:24.486730 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a860b6979be5483dba888a37634d196b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a860b6979be5483dba888a37634d196b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}] Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 5d10a2be3765418cb72eeb6b15db5142 Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:24.490098 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': 'da2b14db-6aa6-44ce-9feb-d990f6424504'} Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:11:24.491637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:24.494934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:24.497547 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Returning 404 to user: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:11:24.497547 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-fbb61f50-b4f9-4152-82df-261995c25523 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 404 len: 111 microversion: 2.1 time: 0.031686 Sep 24 15:11:24.497547 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 534/1078] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:24 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:11:24.503127 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ea557526-9194-4226-a7e1-ba2f40055aa2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '.version_select at 0x7f7c10c06d30>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:24.522568 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ea557526-9194-4226-a7e1-ba2f40055aa2 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559935580" status: 202 len: 0 microversion: 2.1 time: 0.023271 Sep 24 15:11:24.523333 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 545/1079] 10.222.0.61 () {58 vars in 1218 bytes} [Sat Sep 24 15:11:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559935580 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 15:11:29.766331 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:29.766914 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:29.773517 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:29.774055 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:29.774504 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:29.775210 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:29.775682 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:29.776120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:29.790032 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] HTTP exception thrown: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Request method failure captured: Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 HTTP/1.1 Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLx0c7OD8LETaTkbvOdEBZydpTt4jCz0uF7nOEhNKkE-Cazm8Q8W6a__TKykFqKhzvpVCnUgX7bKbSg--1q7_zFDVUVD_ofucVAN6DQb5z-W8kgX-0Ly4YbKgngyNw9GH6YgYieFqxyBmrnX20rFP4a9Zerc8lZU-dMqUOqJzA8F8YyY Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:11:29.791588 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a860b6979be5483dba888a37634d196b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a860b6979be5483dba888a37634d196b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}] Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 5d10a2be3765418cb72eeb6b15db5142 Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.793188 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': 'da2b14db-6aa6-44ce-9feb-d990f6424504'} Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:11:29.794120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.795691 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.797270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Returning 404 to user: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:11:29.797270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-cc54ee60-0cfb-47e3-8670-2f8bab26f69b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "DELETE /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 404 len: 111 microversion: 2.1 time: 0.030892 Sep 24 15:11:29.797270 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 535/1080] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:11:29 2022] DELETE /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:11:29.803809 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:29.804538 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: da2b14db-6aa6-44ce-9feb-d990f6424504] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:29.806475 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:11:29.812483 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:29.812970 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:29.813409 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:29.814126 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:29.814586 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:29.815015 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:29.819895 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:11:29.830895 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] HTTP exception thrown: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Request method failure captured: Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 HTTP/1.1 Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLx0c7OD8LETaTkbvOdEBZydpTt4jCz0uF7nOEhNKkE-Cazm8Q8W6a__TKykFqKhzvpVCnUgX7bKbSg--1q7_zFDVUVD_ofucVAN6DQb5z-W8kgX-0Ly4YbKgngyNw9GH6YgYieFqxyBmrnX20rFP4a9Zerc8lZU-dMqUOqJzA8F8YyY Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:11:29.833222 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a860b6979be5483dba888a37634d196b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a860b6979be5483dba888a37634d196b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}] Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 5d10a2be3765418cb72eeb6b15db5142 Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.834891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'da2b14db-6aa6-44ce-9feb-d990f6424504'} Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:11:29.835830 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. Sep 24 15:11:29.837164 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:29.838283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Returning 404 to user: Instance da2b14db-6aa6-44ce-9feb-d990f6424504 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:11:29.838283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d2e82296-89f6-4b28-883e-4529fa16069b tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504" status: 404 len: 111 microversion: 2.1 time: 0.035998 Sep 24 15:11:29.838283 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 546/1081] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:29 2022] GET /compute/v2.1/servers/da2b14db-6aa6-44ce-9feb-d990f6424504 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:11:32.027891 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:32.028467 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:32.031057 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=21 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:11:32.036740 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:32.037232 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:32.037674 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:32.038403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:32.038867 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:32.039484 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:32.044831 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:11:32.061112 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] HTTP exception thrown: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Request method failure captured: Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 HTTP/1.1 Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLx0c7OD8LETaTkbvOdEBZydpTt4jCz0uF7nOEhNKkE-Cazm8Q8W6a__TKykFqKhzvpVCnUgX7bKbSg--1q7_zFDVUVD_ofucVAN6DQb5z-W8kgX-0Ly4YbKgngyNw9GH6YgYieFqxyBmrnX20rFP4a9Zerc8lZU-dMqUOqJzA8F8YyY Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:11:32.063436 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a860b6979be5483dba888a37634d196b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a860b6979be5483dba888a37634d196b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}] Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 5d10a2be3765418cb72eeb6b15db5142 Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.065113 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': '0c8c8f87-40c5-41e2-9606-068157651b71'} Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:11:32.066387 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.067608 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.069160 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Returning 404 to user: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:11:32.069160 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-2416edb3-9925-47a9-bba6-e8f5b9371a04 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 404 len: 111 microversion: 2.1 time: 0.041682 Sep 24 15:11:32.069160 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 536/1082] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:11:32 2022] DELETE /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:11:32.074838 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:32.075974 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] [instance: 0c8c8f87-40c5-41e2-9606-068157651b71] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:32.084297 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:32.084819 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:32.085359 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:32.085891 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:32.086376 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:32.086808 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:32.102718 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] HTTP exception thrown: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Request method failure captured: Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 HTTP/1.1 Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLx0c7OD8LETaTkbvOdEBZydpTt4jCz0uF7nOEhNKkE-Cazm8Q8W6a__TKykFqKhzvpVCnUgX7bKbSg--1q7_zFDVUVD_ofucVAN6DQb5z-W8kgX-0Ly4YbKgngyNw9GH6YgYieFqxyBmrnX20rFP4a9Zerc8lZU-dMqUOqJzA8F8YyY Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:11:32.104229 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a860b6979be5483dba888a37634d196b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a860b6979be5483dba888a37634d196b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a860b6979be5483dba888a37634d196b"}]}] Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: a860b6979be5483dba888a37634d196b Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1590777089 Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 5d10a2be3765418cb72eeb6b15db5142 Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-AttachVolumeTestJSON-1590777089-project Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.105813 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '0c8c8f87-40c5-41e2-9606-068157651b71'} Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:11:32.106899 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. Sep 24 15:11:32.108372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:11:32.109811 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] Returning 404 to user: Instance 0c8c8f87-40c5-41e2-9606-068157651b71 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:11:32.109811 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8b0b21fc-d4ed-4218-8b11-a4633cf24f76 tempest-AttachVolumeTestJSON-1590777089 tempest-AttachVolumeTestJSON-1590777089-project] 10.222.0.61 "GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71" status: 404 len: 111 microversion: 2.1 time: 0.035837 Sep 24 15:11:32.109811 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 547/1083] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:32 2022] GET /compute/v2.1/servers/0c8c8f87-40c5-41e2-9606-068157651b71 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:11:32.866403 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1301979728", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2128561527", "security_groups": [{"name": "tempest-secgroup-smoke-2056141905"}], "block_device_mapping_v2": [{"uuid": "b87c2af5-86de-42b0-8a8a-7743c8c5e0cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8b98b34-a708-4aa1-8351-cc592752fa2b"}]}} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:11:32.991741 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.network.neutron [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] validate_networks() for [('a8b98b34-a708-4aa1-8351-cc592752fa2b', None, None, None, None, None)] {{(pid=120591) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 15:11:33.410866 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Flavor limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 15:11:33.411464 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Image limits 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 15:11:33.411750 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Flavor pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 15:11:33.412158 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Image pref 0:0:0 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 15:11:33.412568 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.virt.hardware [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120591) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 15:11:33.421646 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:33.422173 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:33.422642 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:33.423369 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:33.423844 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:33.424253 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:33.441257 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Getting quotas for project cd72399e0d4f4e25b992e8e8cf836c18. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 15:11:33.445169 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.quota [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Getting quotas for user 5a93a2d9266541e7bff502ba074fef5c and project cd72399e0d4f4e25b992e8e8cf836c18. Resources: {'instances', 'ram', 'cores'} {{(pid=120591) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 15:11:33.508834 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Going to run 1 instances... {{(pid=120591) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 15:11:33.511082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b87c2af5-86de-42b0-8a8a-7743c8c5e0cf',volume_size=None,volume_type=None)] {{(pid=120591) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 15:11:33.656063 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-5e9822a9-5c12-4f6c-baff-9f76606da2e5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.794730 Sep 24 15:11:33.657323 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 537/1084] 10.222.0.61 () {60 vars in 1147 bytes} [Sat Sep 24 15:11:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 15:11:33.668303 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-0b2d3003-2513-4de8-afde-497049e5912b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:33.669565 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-0b2d3003-2513-4de8-afde-497049e5912b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:33.749639 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-0b2d3003-2513-4de8-afde-497049e5912b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:33.762777 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-0b2d3003-2513-4de8-afde-497049e5912b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1095 microversion: 2.1 time: 0.098274 Sep 24 15:11:33.763863 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 548/1085] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:33 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:34.786738 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:34.787971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:34.794356 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:34.795060 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:34.795664 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:34.796821 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:34.797577 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:34.798187 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:34.887550 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:34.901067 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-700099d8-9708-48f1-a3f0-453272efac4a tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1193 microversion: 2.1 time: 0.117660 Sep 24 15:11:34.902982 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 538/1086] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:34 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:35.924878 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:35.926065 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:35.935458 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:35.936236 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:35.936925 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:35.938719 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:35.939300 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:35.939848 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:36.031575 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:36.039485 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ed73ad70-16e7-40f5-8a00-0ab4309cd808 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1199 microversion: 2.1 time: 0.118402 Sep 24 15:11:36.040194 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 549/1087] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:35 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1199 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:36.871591 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-6d1e3557-5436-4767-906f-8b3cfc221e51 req-e7c410f3-0913-47fc-94e7-2e2abf05ad82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1becf18c-1bb3-4e93-ae58-82467c240ca3", "tag": "39afd56d-6376-4d3f-b312-ea853973a295"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:11:36.883292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-6d1e3557-5436-4767-906f-8b3cfc221e51 req-e7c410f3-0913-47fc-94e7-2e2abf05ad82 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:36.884587 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-6d1e3557-5436-4767-906f-8b3cfc221e51 req-e7c410f3-0913-47fc-94e7-2e2abf05ad82 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:36.885402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-6d1e3557-5436-4767-906f-8b3cfc221e51 req-e7c410f3-0913-47fc-94e7-2e2abf05ad82 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:36.902946 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-6d1e3557-5436-4767-906f-8b3cfc221e51 req-e7c410f3-0913-47fc-94e7-2e2abf05ad82 service nova] Creating event network-changed:39afd56d-6376-4d3f-b312-ea853973a295 for instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 on hv-cinder-85919 Sep 24 15:11:36.911974 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-6d1e3557-5436-4767-906f-8b3cfc221e51 req-e7c410f3-0913-47fc-94e7-2e2abf05ad82 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044477 Sep 24 15:11:36.913521 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 539/1088] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:37.062643 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:37.063232 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:37.069820 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:37.070420 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:37.070857 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:37.071556 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:37.072212 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:37.073055 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:37.314534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:37.322605 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-d7a9eb10-5dc2-4ec6-b164-9baca9ac3f25 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.263706 Sep 24 15:11:37.323712 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 550/1089] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:37 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:38.347143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:38.347855 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:38.354203 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:38.354705 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:38.355152 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:38.355852 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:38.356319 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:38.356760 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:38.485289 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:38.494059 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d8b08c75-5ec7-4e93-b1b6-64b971bbe26d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.151640 Sep 24 15:11:38.494629 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 540/1090] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:38 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:39.516366 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:39.516982 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:39.523939 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:39.524426 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:39.524866 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:39.525568 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:39.526062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:39.526496 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:39.656823 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:39.664459 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-c6f2e45f-4a5c-4d42-b2b0-17eb55a1dc52 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.151950 Sep 24 15:11:39.665031 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 551/1091] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:39 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:40.687600 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:40.688252 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:40.695603 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:40.696099 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:40.696550 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:40.697250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:40.697717 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:40.698175 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:40.826075 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:40.833800 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-620a1e80-8187-467d-b41b-cfad982328f9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.150229 Sep 24 15:11:40.834407 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 541/1092] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:40 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:41.859615 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:41.860260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:41.867140 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:41.867886 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:41.868327 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:41.869024 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:41.869488 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:41.869983 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:41.997552 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:42.005633 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-18c76f19-c48e-43d0-ae80-e735c319f695 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.149914 Sep 24 15:11:42.006228 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 552/1093] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:41 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:43.028512 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:43.029129 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:43.035470 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:43.035955 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:43.036402 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:43.037091 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:43.037556 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:43.038012 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:43.168065 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:43.175622 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-d49c852b-16ce-476f-b4f9-54684bea9313 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.151311 Sep 24 15:11:43.176187 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 542/1094] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:43 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:44.198757 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:44.199372 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:44.201690 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell0:SELECT=2 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:11:44.207645 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:44.208138 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:44.208579 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:44.209276 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:44.209737 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:44.210196 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:44.344370 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:44.352829 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-abb29241-ad0c-4ada-8cbe-221f4b9480fe tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.157957 Sep 24 15:11:44.353397 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 553/1095] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:44 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:45.375725 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:45.376341 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:45.378595 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=2 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:11:45.379250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell0:SELECT=6 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:11:45.385250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:45.385736 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:45.386205 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:45.386894 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:45.387348 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:45.387773 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:45.521694 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:45.529592 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-83c38845-3ac6-466c-8a02-846c18c3dea8 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.157754 Sep 24 15:11:45.530206 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 543/1096] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:45 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:46.552745 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:46.553362 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:46.559734 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:46.560244 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:46.560694 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:46.561401 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:46.561872 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:46.562714 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:46.695363 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:46.703173 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bfca96ea-e8c7-4c9f-9fc4-d4bf2cab2880 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.154426 Sep 24 15:11:46.703749 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 554/1097] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:46 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:47.726526 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:47.727150 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:47.733636 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:47.734161 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:47.734609 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:47.735312 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:47.735775 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:47.736209 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:48.092250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:48.100626 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-9de16153-0b02-4d03-8609-095379b56d90 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.378150 Sep 24 15:11:48.101534 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 544/1098] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:47 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:48.427505 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-43157221-315c-4dc8-8793-c6da0b81b634 req-d77ecec8-1269-43f6-9399-b94a16dce266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1becf18c-1bb3-4e93-ae58-82467c240ca3", "name": "network-vif-plugged", "status": "completed", "tag": "39afd56d-6376-4d3f-b312-ea853973a295"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:11:48.436790 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-43157221-315c-4dc8-8793-c6da0b81b634 req-d77ecec8-1269-43f6-9399-b94a16dce266 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:48.437262 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-43157221-315c-4dc8-8793-c6da0b81b634 req-d77ecec8-1269-43f6-9399-b94a16dce266 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:48.437691 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-43157221-315c-4dc8-8793-c6da0b81b634 req-d77ecec8-1269-43f6-9399-b94a16dce266 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:48.593566 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-43157221-315c-4dc8-8793-c6da0b81b634 req-d77ecec8-1269-43f6-9399-b94a16dce266 service nova] Creating event network-vif-plugged:39afd56d-6376-4d3f-b312-ea853973a295 for instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 on hv-cinder-85919 Sep 24 15:11:48.598562 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-43157221-315c-4dc8-8793-c6da0b81b634 req-d77ecec8-1269-43f6-9399-b94a16dce266 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293182 Sep 24 15:11:48.599158 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 555/1099] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:11:49.122820 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:49.124422 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:49.130269 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:49.132100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:49.132100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:49.132100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:49.132406 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:49.132772 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:49.267416 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:49.275052 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e7c041c8-f417-4186-a0d3-22e244ac785f tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1267 microversion: 2.1 time: 0.156281 Sep 24 15:11:49.275619 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 545/1100] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:49 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:50.302633 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:50.303343 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:50.309427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:50.309951 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:50.310402 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:50.311106 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:50.311570 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:50.312004 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:50.444332 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:50.452085 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-bde49ee4-9008-449c-8e95-e9ec48e659f2 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1453 microversion: 2.1 time: 0.154896 Sep 24 15:11:50.452647 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 556/1101] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:50 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:11:50.474705 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:11:50.475321 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:11:50.481875 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:50.482392 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:50.482829 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:50.483523 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:50.483982 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:50.484408 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:50.616945 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:11:50.625138 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-929eb6dc-03df-4dfc-96e7-56ba5c7d5852 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1453 microversion: 2.1 time: 0.155118 Sep 24 15:11:50.625705 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 546/1102] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:11:50 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:11:52.253613 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-747b15ad-6c30-4121-9750-dc968db7c60d req-c3780855-e7c6-476b-b2f9-a186d9edc738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1becf18c-1bb3-4e93-ae58-82467c240ca3", "tag": "39afd56d-6376-4d3f-b312-ea853973a295"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:11:52.262748 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-747b15ad-6c30-4121-9750-dc968db7c60d req-c3780855-e7c6-476b-b2f9-a186d9edc738 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:11:52.263226 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-747b15ad-6c30-4121-9750-dc968db7c60d req-c3780855-e7c6-476b-b2f9-a186d9edc738 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:11:52.263659 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-747b15ad-6c30-4121-9750-dc968db7c60d req-c3780855-e7c6-476b-b2f9-a186d9edc738 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:11:52.274905 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-747b15ad-6c30-4121-9750-dc968db7c60d req-c3780855-e7c6-476b-b2f9-a186d9edc738 service nova] Creating event network-changed:39afd56d-6376-4d3f-b312-ea853973a295 for instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 on hv-cinder-85919 Sep 24 15:11:52.279637 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-747b15ad-6c30-4121-9750-dc968db7c60d req-c3780855-e7c6-476b-b2f9-a186d9edc738 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084047 Sep 24 15:11:52.281628 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 557/1103] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:13:31.884420 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:13:31.886599 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 15:13:31.887151 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Sat Sep 24 15:13:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 24 15:13:31.887267 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG dbcounter [-] [120591] Writing DB stats nova_cell1:SELECT=53 {{(pid=120591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:13:31.887979 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 15:13:31.888322 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Sat Sep 24 15:13:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 (ip 10.222.0.61) !!! Sep 24 15:13:31.888669 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_api:SELECT=25 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:13:31.889558 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG dbcounter [-] [120590] Writing DB stats nova_cell1:SELECT=49 {{(pid=120590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 15:13:31.894707 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-29c0df37-b4b2-44c6-99a5-c8f68cd8c0cf req-1cc3af68-0f55-451e-8c60-aa02001817e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1becf18c-1bb3-4e93-ae58-82467c240ca3", "tag": "39afd56d-6376-4d3f-b312-ea853973a295"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:13:31.895025 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:31.895416 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:31.906036 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:31.906723 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:31.907166 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:31.907877 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:31.908337 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:31.908765 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:31.912784 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-29c0df37-b4b2-44c6-99a5-c8f68cd8c0cf req-1cc3af68-0f55-451e-8c60-aa02001817e4 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:31.913534 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-29c0df37-b4b2-44c6-99a5-c8f68cd8c0cf req-1cc3af68-0f55-451e-8c60-aa02001817e4 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:31.914676 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-29c0df37-b4b2-44c6-99a5-c8f68cd8c0cf req-1cc3af68-0f55-451e-8c60-aa02001817e4 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:31.927705 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-29c0df37-b4b2-44c6-99a5-c8f68cd8c0cf req-1cc3af68-0f55-451e-8c60-aa02001817e4 service nova] Creating event network-changed:39afd56d-6376-4d3f-b312-ea853973a295 for instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 on hv-cinder-85919 Sep 24 15:13:31.934410 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-29c0df37-b4b2-44c6-99a5-c8f68cd8c0cf req-1cc3af68-0f55-451e-8c60-aa02001817e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048770 Sep 24 15:13:31.935366 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 558/1104] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:13:31.949250 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:13:32.038909 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-08777fbd-6662-41b7-9cfc-7168f9863e2c tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 204 len: 0 microversion: 2.1 time: 0.155943 Sep 24 15:13:32.039698 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 547/1105] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:13:31 2022] DELETE /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:13:32.049049 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:32.049443 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:32.055822 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:32.056330 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:32.056787 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:32.057503 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:32.058189 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:32.058797 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:32.222560 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:32.230614 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-536581f7-5ecb-4c18-bec5-eba45586693d tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1578 microversion: 2.1 time: 0.186182 Sep 24 15:13:32.231187 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 559/1106] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:32 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:13:33.254644 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:33.255351 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:33.262538 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:33.263029 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:33.263473 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:33.264173 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:33.264637 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:33.265084 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:33.398929 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:33.406632 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bf9d6804-903e-48ca-b7d4-a657c265ee54 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1578 microversion: 2.1 time: 0.156464 Sep 24 15:13:33.407201 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 548/1107] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:33 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:13:34.431260 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:34.431903 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:34.438533 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:34.439035 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:34.439482 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:34.440186 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:34.440654 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:34.441122 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:34.571650 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:34.579319 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-ec1b080f-1961-4d42-901e-7483f3dc7a2b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1578 microversion: 2.1 time: 0.152741 Sep 24 15:13:34.579880 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 560/1108] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:34 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:13:35.602998 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:35.603604 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:35.609966 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:35.610462 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:35.610902 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:35.611594 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:35.612052 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:35.612483 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:35.741490 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:35.749133 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-8bd183d8-2dae-4ee5-83c8-6a77efabaef4 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1578 microversion: 2.1 time: 0.150008 Sep 24 15:13:35.749700 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 549/1109] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:35 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 15:13:36.771736 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:36.772321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:36.779278 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:36.779765 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:36.780200 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:36.780892 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:36.781346 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:36.781771 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:36.843884 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-66216bd0-b3b9-4ddf-bfd5-6e55b385ba00 req-4004264b-0f5a-496d-a3a1-8eff849a7d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1becf18c-1bb3-4e93-ae58-82467c240ca3", "name": "network-vif-unplugged", "status": "completed", "tag": "39afd56d-6376-4d3f-b312-ea853973a295"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:13:36.855510 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-66216bd0-b3b9-4ddf-bfd5-6e55b385ba00 req-4004264b-0f5a-496d-a3a1-8eff849a7d6f service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:36.856002 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-66216bd0-b3b9-4ddf-bfd5-6e55b385ba00 req-4004264b-0f5a-496d-a3a1-8eff849a7d6f service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:36.856522 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-66216bd0-b3b9-4ddf-bfd5-6e55b385ba00 req-4004264b-0f5a-496d-a3a1-8eff849a7d6f service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:36.868840 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-66216bd0-b3b9-4ddf-bfd5-6e55b385ba00 req-4004264b-0f5a-496d-a3a1-8eff849a7d6f service nova] Creating event network-vif-unplugged:39afd56d-6376-4d3f-b312-ea853973a295 for instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 on hv-cinder-85919 Sep 24 15:13:36.875531 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-66216bd0-b3b9-4ddf-bfd5-6e55b385ba00 req-4004264b-0f5a-496d-a3a1-8eff849a7d6f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035183 Sep 24 15:13:36.876223 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 550/1110] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 15:13:36.925087 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:36.934041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-930ecada-576c-4b1b-826d-968d86948fd9 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1578 microversion: 2.1 time: 0.166070 Sep 24 15:13:36.934623 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 561/1111] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:36 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:13:37.959204 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:37.959934 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:37.966122 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:37.966617 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:37.967063 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:37.967784 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:37.968249 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:37.968681 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:38.097087 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:38.105244 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-39081ac3-3e05-4d65-97fc-269e0cb5060b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1578 microversion: 2.1 time: 0.150833 Sep 24 15:13:38.105811 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 551/1112] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:37 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:13:39.129016 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:39.129639 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:39.136396 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:39.136941 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:39.137390 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:39.138129 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:39.138609 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:39.139058 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:39.322183 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:39.330512 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-3cd74499-9bf3-4a7e-9f8e-36a5afd691f1 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 200 len: 1459 microversion: 2.1 time: 0.205371 Sep 24 15:13:39.331100 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 562/1113] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:39 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 1459 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:13:39.424451 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-a5ebdf9b-2c75-49a6-abf2-95b0c0c9e04b req-eddc9662-141a-47e2-b570-5e84599f34a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1becf18c-1bb3-4e93-ae58-82467c240ca3", "name": "network-vif-deleted", "tag": "39afd56d-6376-4d3f-b312-ea853973a295"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:13:39.435870 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-a5ebdf9b-2c75-49a6-abf2-95b0c0c9e04b req-eddc9662-141a-47e2-b570-5e84599f34a9 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:39.436342 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-a5ebdf9b-2c75-49a6-abf2-95b0c0c9e04b req-eddc9662-141a-47e2-b570-5e84599f34a9 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:39.437482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-a5ebdf9b-2c75-49a6-abf2-95b0c0c9e04b req-eddc9662-141a-47e2-b570-5e84599f34a9 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:39.449515 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-a5ebdf9b-2c75-49a6-abf2-95b0c0c9e04b req-eddc9662-141a-47e2-b570-5e84599f34a9 service nova] Creating event network-vif-deleted:39afd56d-6376-4d3f-b312-ea853973a295 for instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 on hv-cinder-85919 Sep 24 15:13:39.455186 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-a5ebdf9b-2c75-49a6-abf2-95b0c0c9e04b req-eddc9662-141a-47e2-b570-5e84599f34a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034760 Sep 24 15:13:39.455971 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 552/1114] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:13:40.354056 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:40.354662 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 1becf18c-1bb3-4e93-ae58-82467c240ca3] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:40.360954 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:40.361442 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:40.361878 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:40.362585 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:40.363046 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:40.363468 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:40.376865 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] HTTP exception thrown: Instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 could not be found. Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Request method failure captured: Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 HTTP/1.1 Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLx0JL6gtG2eWWUHRpR8rnNWhkXcsvsP8811D3DrQhsaBWYS34v33lmdEOkd_g95CpIH67v8Or1DbdIwL2jfCfhjWsyVJQJd2dz2D5Ee_rOuen6EQHXIG0rjp_IsdEkdQhQ33_6Zjf7eh2LQ2mVOXDomVJrldK2XN1zleJ86n-2nGwWM Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:13:40.378515 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}] Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 5a93a2d9266541e7bff502ba074fef5c Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 could not be found. Sep 24 15:13:40.380321 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '1becf18c-1bb3-4e93-ae58-82467c240ca3'} Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 could not be found. Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:13:40.381495 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 could not be found. Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 could not be found. Sep 24 15:13:40.383778 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:40.385469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Returning 404 to user: Instance 1becf18c-1bb3-4e93-ae58-82467c240ca3 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:13:40.385469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e9758eaa-7695-4ee1-bbcb-336fb00ac486 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3" status: 404 len: 111 microversion: 2.1 time: 0.029727 Sep 24 15:13:40.385469 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 563/1115] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:40 2022] GET /compute/v2.1/servers/1becf18c-1bb3-4e93-ae58-82467c240ca3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:13:43.635482 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:43.636082 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:43.642099 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [req-c4bb5c32-c38e-407c-a10f-b97e9411bb9e req-26d68fbc-c94b-4e51-904e-e5e9ce198b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5de7e1cd-a661-41b9-bcd8-e4ab67c432ab", "tag": "8c6c7f66-b862-4791-a698-9b5965a87bf3"}]} {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:13:43.643077 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:43.643578 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:43.644028 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:43.644742 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:43.645214 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:43.645652 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:43.654738 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-c4bb5c32-c38e-407c-a10f-b97e9411bb9e req-26d68fbc-c94b-4e51-904e-e5e9ce198b3e service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:43.655231 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-c4bb5c32-c38e-407c-a10f-b97e9411bb9e req-26d68fbc-c94b-4e51-904e-e5e9ce198b3e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:43.655882 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [req-c4bb5c32-c38e-407c-a10f-b97e9411bb9e req-26d68fbc-c94b-4e51-904e-e5e9ce198b3e service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:43.668041 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.compute.server_external_events [req-c4bb5c32-c38e-407c-a10f-b97e9411bb9e req-26d68fbc-c94b-4e51-904e-e5e9ce198b3e service nova] Creating event network-changed:8c6c7f66-b862-4791-a698-9b5965a87bf3 for instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab on hv-cinder-85919 Sep 24 15:13:43.673376 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [req-c4bb5c32-c38e-407c-a10f-b97e9411bb9e req-26d68fbc-c94b-4e51-904e-e5e9ce198b3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034773 Sep 24 15:13:43.673998 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 564/1116] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:13:43.678004 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Going to try to terminate instance {{(pid=120591) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 15:13:43.769233 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-79ea974c-ecf2-4615-b96c-486065f283a5 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 204 len: 0 microversion: 2.1 time: 0.137502 Sep 24 15:13:43.769742 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 553/1117] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:13:43 2022] DELETE /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 15:13:43.778937 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:43.779646 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:43.785675 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:43.786211 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:43.786664 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:43.787367 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:43.787927 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:43.788954 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:43.926427 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:43.935147 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-33c45221-8751-4c97-83a1-eac87e4a4130 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1577 microversion: 2.1 time: 0.160263 Sep 24 15:13:43.935726 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 565/1118] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:43 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:13:44.959021 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:44.959727 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:44.966083 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:44.966575 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:44.967017 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:44.967714 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:44.968175 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:44.968605 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:45.108001 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.policy [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120591) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:45.117281 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-09c461c8-b39d-46c4-858a-cb2b8c56c010 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1577 microversion: 2.1 time: 0.161930 Sep 24 15:13:45.117854 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 554/1119] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:44 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:13:46.140425 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:46.141223 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:46.148498 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:46.149081 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:46.149598 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:46.150408 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:46.150946 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:46.151452 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:46.227940 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.policy [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a93a2d9266541e7bff502ba074fef5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd72399e0d4f4e25b992e8e8cf836c18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120590) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 15:13:46.235802 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-8267d3a5-4239-4286-aedd-cd33f4a50b6b tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 200 len: 1391 microversion: 2.1 time: 0.099316 Sep 24 15:13:46.236588 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 566/1120] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:46 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 1391 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 15:13:46.255905 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [req-f91ff52f-1c8e-4d3c-8348-c9b08dc52d5f req-01873183-f9ed-4d59-a89d-90ba96c05876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5de7e1cd-a661-41b9-bcd8-e4ab67c432ab", "name": "network-vif-deleted", "tag": "8c6c7f66-b862-4791-a698-9b5965a87bf3"}]} {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 15:13:46.266431 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-f91ff52f-1c8e-4d3c-8348-c9b08dc52d5f req-01873183-f9ed-4d59-a89d-90ba96c05876 service nova] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:46.267006 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-f91ff52f-1c8e-4d3c-8348-c9b08dc52d5f req-01873183-f9ed-4d59-a89d-90ba96c05876 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:46.267442 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [req-f91ff52f-1c8e-4d3c-8348-c9b08dc52d5f req-01873183-f9ed-4d59-a89d-90ba96c05876 service nova] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:46.278531 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.compute.server_external_events [req-f91ff52f-1c8e-4d3c-8348-c9b08dc52d5f req-01873183-f9ed-4d59-a89d-90ba96c05876 service nova] Creating event network-vif-deleted:8c6c7f66-b862-4791-a698-9b5965a87bf3 for instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab on hv-cinder-85919 Sep 24 15:13:46.284292 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [req-f91ff52f-1c8e-4d3c-8348-c9b08dc52d5f req-01873183-f9ed-4d59-a89d-90ba96c05876 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031911 Sep 24 15:13:46.284883 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 555/1121] 10.222.0.61 () {64 vars in 1317 bytes} [Sat Sep 24 15:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 15:13:47.261088 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:47.261681 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:47.267501 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:47.267991 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:47.268432 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:47.269128 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:47.269595 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:47.270062 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:47.283591 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] HTTP exception thrown: Instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab could not be found. Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Request method failure captured: Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab HTTP/1.1 Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLx0JL6gtG2eWWUHRpR8rnNWhkXcsvsP8811D3DrQhsaBWYS34v33lmdEOkd_g95CpIH67v8Or1DbdIwL2jfCfhjWsyVJQJd2dz2D5Ee_rOuen6EQHXIG0rjp_IsdEkdQhQ33_6Zjf7eh2LQ2mVOXDomVJrldK2XN1zleJ86n-2nGwWM Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:13:47.285208 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}] Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 5a93a2d9266541e7bff502ba074fef5c Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab could not be found. Sep 24 15:13:47.286912 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': '5de7e1cd-a661-41b9-bcd8-e4ab67c432ab'} Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab could not be found. Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:13:47.287856 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab could not be found. Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab could not be found. Sep 24 15:13:47.289578 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.291257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Returning 404 to user: Instance 5de7e1cd-a661-41b9-bcd8-e4ab67c432ab could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:13:47.291257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-e45da0b0-a8f1-4cee-ace5-f6850eb4456e tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab" status: 404 len: 111 microversion: 2.1 time: 0.030229 Sep 24 15:13:47.291257 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 567/1122] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:47 2022] GET /compute/v2.1/servers/5de7e1cd-a661-41b9-bcd8-e4ab67c432ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:13:47.722100 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:47.722703 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.compute.api [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120591) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:47.729552 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:47.730093 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:47.730544 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:47.731253 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:47.731725 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:47.732159 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG oslo_concurrency.lockutils [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:47.745924 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.wsgi [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] HTTP exception thrown: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Request method failure captured: Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: request: DELETE /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 HTTP/1.1 Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept: application/json Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Accept-Encoding: identity Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Connection: close Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Length: 0 Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Content-Type: application/json Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Host: 10.222.0.61 Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: Openstack-System-Scope: None Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: User-Agent: python-urllib3/1.26.12 Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Auth-Token: gAAAAABjLx0JL6gtG2eWWUHRpR8rnNWhkXcsvsP8811D3DrQhsaBWYS34v33lmdEOkd_g95CpIH67v8Or1DbdIwL2jfCfhjWsyVJQJd2dz2D5Ee_rOuen6EQHXIG0rjp_IsdEkdQhQ33_6Zjf7eh2LQ2mVOXDomVJrldK2XN1zleJ86n-2nGwWM Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Id: None Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Domain-Name: None Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Identity-Status: Confirmed Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Is-Admin-Project: True Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Id: default Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Domain-Name: Default Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Project-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Role: reader,member Sep 24 15:13:47.748361 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Roles: reader,member Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}] Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-Tenant-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Id: default Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Domain-Name: Default Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Id: 5a93a2d9266541e7bff502ba074fef5c Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: X-User-Name: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: method: > Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: exception: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.750182 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: action_args: {'id': 'ed3ca454-06df-4300-8b9a-d516ac3b5773'} Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:13:47.751120 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.752511 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.753893 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Returning 404 to user: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. {{(pid=120591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:13:47.753893 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-e453614c-b101-48be-a5ea-c48322d1ace6 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 404 len: 111 microversion: 2.1 time: 0.032636 Sep 24 15:13:47.753893 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 556/1123] 10.222.0.61 () {58 vars in 1239 bytes} [Sat Sep 24 15:13:47 2022] DELETE /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:13:47.759909 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '>' {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:47.760530 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.compute.api [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] [instance: ed3ca454-06df-4300-8b9a-d516ac3b5773] Fetching instance by UUID {{(pid=120590) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 15:13:47.766519 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:47.767159 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:47.767717 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:47.768527 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Acquiring lock "15cdcebc-e767-48fd-9484-d2808c084625" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 15:13:47.769021 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 15:13:47.769459 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG oslo_concurrency.lockutils [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Lock "15cdcebc-e767-48fd-9484-d2808c084625" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 15:13:47.783628 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.wsgi [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] HTTP exception thrown: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Request method failure captured: Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: request: GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 HTTP/1.1 Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept: application/json Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Accept-Encoding: identity Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Connection: close Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Length: 0 Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Content-Type: application/json Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Host: 10.222.0.61 Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: Openstack-System-Scope: None Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: User-Agent: python-urllib3/1.26.12 Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Auth-Token: gAAAAABjLx0JL6gtG2eWWUHRpR8rnNWhkXcsvsP8811D3DrQhsaBWYS34v33lmdEOkd_g95CpIH67v8Or1DbdIwL2jfCfhjWsyVJQJd2dz2D5Ee_rOuen6EQHXIG0rjp_IsdEkdQhQ33_6Zjf7eh2LQ2mVOXDomVJrldK2XN1zleJ86n-2nGwWM Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Id: None Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Domain-Name: None Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Identity-Status: Confirmed Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Is-Admin-Project: True Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Id: default Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Domain-Name: Default Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Project-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Role: reader,member Sep 24 15:13:47.785171 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Roles: reader,member Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cd72399e0d4f4e25b992e8e8cf836c18"}]}] Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Id: cd72399e0d4f4e25b992e8e8cf836c18 Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-Tenant-Name: tempest-TestVolumeBootPattern-293612076 Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Id: default Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Domain-Name: Default Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Id: 5a93a2d9266541e7bff502ba074fef5c Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: X-User-Name: tempest-TestVolumeBootPattern-293612076-project Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: method: > Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: exception: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.786985 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: action_args: {'id': 'ed3ca454-06df-4300-8b9a-d516ac3b5773'} Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: {{(pid=120590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 15:13:47.787965 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. Sep 24 15:13:47.790116 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: ERROR nova.api.openstack.wsgi Sep 24 15:13:47.792098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: DEBUG nova.api.openstack.wsgi [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Returning 404 to user: Instance ed3ca454-06df-4300-8b9a-d516ac3b5773 could not be found. {{(pid=120590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 15:13:47.792098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: INFO nova.api.openstack.requestlog [None req-75207123-daed-4b7e-9d48-1cb12a7155bb tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773" status: 404 len: 111 microversion: 2.1 time: 0.031333 Sep 24 15:13:47.792098 dv-cinder-859194-1-iscsi devstack@n-api.service[120590]: [pid: 120590|app: 0|req: 568/1124] 10.222.0.61 () {58 vars in 1236 bytes} [Sat Sep 24 15:13:47 2022] GET /compute/v2.1/servers/ed3ca454-06df-4300-8b9a-d516ac3b5773 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 15:13:49.087143 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: DEBUG nova.api.openstack.wsgi [None req-bd0ad390-cc85-4f80-b965-2dbf2888ee19 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] Calling method '.version_select at 0x7f7c10f1f3a0>' {{(pid=120591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 15:13:49.112961 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: INFO nova.api.openstack.requestlog [None req-bd0ad390-cc85-4f80-b965-2dbf2888ee19 tempest-TestVolumeBootPattern-293612076 tempest-TestVolumeBootPattern-293612076-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2128561527" status: 202 len: 0 microversion: 2.1 time: 0.030176 Sep 24 15:13:49.113745 dv-cinder-859194-1-iscsi devstack@n-api.service[120591]: [pid: 120591|app: 0|req: 557/1125] 10.222.0.61 () {58 vars in 1263 bytes} [Sat Sep 24 15:13:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2128561527 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)